2025-01-08 23:50:36,722 - INFO - Using existing project ['default-domain', 'k8s-default'](b576a409-e92f-4f24-8b5a-a3097b9ed540) 2025-01-08 23:50:36,745 - DEBUG - Namespace ctest-new-default-49447188 not present 2025-01-08 23:50:36,759 - INFO - Created namespace ctest-new-default-49447188 2025-01-08 23:50:39,764 - DEBUG - Namespace ctest-non-default-83698344 not present 2025-01-08 23:50:39,781 - INFO - Created namespace ctest-non-default-83698344 2025-01-08 23:50:42,807 - DEBUG - Pod ctest-pod-09146326 not present 2025-01-08 23:50:42,807 - INFO - Creating Pod ctest-pod-09146326 2025-01-08 23:50:42,843 - DEBUG - Pod : ctest-pod-09146326 UUID is aa3dd657-a58a-4507-a70e-429f1c8cad09 2025-01-08 23:50:42,861 - DEBUG - Pod ctest-pod-29096005 not present 2025-01-08 23:50:42,867 - INFO - Creating Pod ctest-pod-29096005 2025-01-08 23:50:42,887 - DEBUG - Pod : ctest-pod-29096005 UUID is d97b46a5-ad52-4f91-a8e6-50200238a516 2025-01-08 23:50:42,896 - DEBUG - Pod ctest-pod-13645571 not present 2025-01-08 23:50:42,897 - INFO - Creating Pod ctest-pod-13645571 2025-01-08 23:50:42,938 - DEBUG - Pod : ctest-pod-13645571 UUID is 01796129-44af-4ecc-9f3a-875515526df8 2025-01-08 23:50:42,943 - DEBUG - Pod ctest-pod-03837081 not present 2025-01-08 23:50:42,943 - INFO - Creating Pod ctest-pod-03837081 2025-01-08 23:50:42,985 - DEBUG - Pod : ctest-pod-03837081 UUID is c1644bec-4fc5-4964-9ab4-f8b1796146d1 2025-01-08 23:50:42,988 - DEBUG - Pod ctest-pod-75938134 not present 2025-01-08 23:50:42,988 - INFO - Creating Pod ctest-pod-75938134 2025-01-08 23:50:43,022 - DEBUG - Pod : ctest-pod-75938134 UUID is baba0be5-f49b-4e1b-9c29-c55d3860da5d 2025-01-08 23:50:43,027 - DEBUG - Pod ctest-pod-14002571 not present 2025-01-08 23:50:43,027 - INFO - Creating Pod ctest-pod-14002571 2025-01-08 23:50:43,049 - DEBUG - Pod : ctest-pod-14002571 UUID is 58290606-72b2-447d-9dc9-d81d979f7481 2025-01-08 23:50:43,052 - DEBUG - Pod ctest-pod-65478719 not present 2025-01-08 23:50:43,052 - INFO - Creating Pod ctest-pod-65478719 2025-01-08 23:50:43,082 - DEBUG - Pod : ctest-pod-65478719 UUID is 78efcff5-b51f-4734-baff-b6f28688e4e1 2025-01-08 23:50:43,087 - DEBUG - Pod ctest-pod-63618879 not present 2025-01-08 23:50:43,089 - INFO - Creating Pod ctest-pod-63618879 2025-01-08 23:50:43,118 - DEBUG - Pod : ctest-pod-63618879 UUID is 15400d41-e170-414c-aac9-6d8dc917e5e9 2025-01-08 23:50:43,341 - INFO - Project default-domain:k8s-ctest-new-default-49447188 for Namespace ctest-new-default-49447188 is seen in contrail-api 2025-01-08 23:50:43,342 - DEBUG - Project uuid in Contrail is d0a1aac3-a436-4c38-b0d8-b6d0f805334d 2025-01-08 23:50:43,576 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=b7e123fb-f214-4482-9c15-5066e8c5a9b0 2025-01-08 23:50:43,582 - INFO - Namespace ctest-new-default-49447188 with uuid b7e123fb-f214-4482-9c15-5066e8c5a9b0 found in kube manager 2025-01-08 23:50:43,582 - INFO - Namespace ctest-new-default-49447188 verification passed 2025-01-08 23:50:43,871 - INFO - Project default-domain:k8s-ctest-non-default-83698344 for Namespace ctest-non-default-83698344 is seen in contrail-api 2025-01-08 23:50:43,872 - DEBUG - Project uuid in Contrail is 1a4ded77-9daf-45ea-ade3-a21c72489f73 2025-01-08 23:50:43,873 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=1d9de7cf-cb95-4a34-bf82-ebec4e0d9278 2025-01-08 23:50:43,884 - INFO - Namespace ctest-non-default-83698344 with uuid 1d9de7cf-cb95-4a34-bf82-ebec4e0d9278 found in kube manager 2025-01-08 23:50:43,885 - INFO - Namespace ctest-non-default-83698344 verification passed 2025-01-08 23:50:43,894 - DEBUG - Pod ctest-pod-09146326 not in running state.Currently in Pending 2025-01-08 23:50:48,910 - DEBUG - Pod ctest-pod-09146326 not in running state.Currently in Pending 2025-01-08 23:50:53,918 - INFO - Pod ctest-pod-09146326 is in running state.Got IP 10.47.255.251 2025-01-08 23:50:53,939 - DEBUG - Pod ctest-pod-09146326 has vmi 607b7a38-ce1b-11ef-9236-fa163eda53e7 2025-01-08 23:50:53,939 - INFO - Verified pod ctest-pod-09146326 in contrail-api 2025-01-08 23:50:53,956 - DEBUG - VMI 607b7a38-ce1b-11ef-9236-fa163eda53e7 is active in agent 10.0.0.46 2025-01-08 23:50:53,957 - INFO - Verified Pod ctest-pod-09146326 in agent 10.0.0.46 2025-01-08 23:50:53,957 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=aa3dd657-a58a-4507-a70e-429f1c8cad09 2025-01-08 23:50:53,964 - INFO - Pod ctest-pod-09146326 with uuid aa3dd657-a58a-4507-a70e-429f1c8cad09 found in kube manager 2025-01-08 23:50:53,964 - INFO - Pod ctest-pod-09146326 verification passed 2025-01-08 23:50:53,969 - DEBUG - Pod ctest-pod-29096005 not in running state.Currently in Pending 2025-01-08 23:50:58,975 - INFO - Pod ctest-pod-29096005 is in running state.Got IP 10.47.255.250 2025-01-08 23:50:58,991 - DEBUG - Pod ctest-pod-29096005 has vmi 61129ab2-ce1b-11ef-9236-fa163eda53e7 2025-01-08 23:50:58,991 - INFO - Verified pod ctest-pod-29096005 in contrail-api 2025-01-08 23:50:59,005 - DEBUG - VMI 61129ab2-ce1b-11ef-9236-fa163eda53e7 is active in agent 10.0.0.46 2025-01-08 23:50:59,005 - INFO - Verified Pod ctest-pod-29096005 in agent 10.0.0.46 2025-01-08 23:50:59,006 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=d97b46a5-ad52-4f91-a8e6-50200238a516 2025-01-08 23:50:59,011 - INFO - Pod ctest-pod-29096005 with uuid d97b46a5-ad52-4f91-a8e6-50200238a516 found in kube manager 2025-01-08 23:50:59,011 - INFO - Pod ctest-pod-29096005 verification passed 2025-01-08 23:50:59,023 - INFO - Pod ctest-pod-13645571 is in running state.Got IP 10.47.255.249 2025-01-08 23:50:59,081 - DEBUG - Pod ctest-pod-13645571 has vmi 61eb83c2-ce1b-11ef-9236-fa163eda53e7 2025-01-08 23:50:59,081 - INFO - Verified pod ctest-pod-13645571 in contrail-api 2025-01-08 23:50:59,096 - DEBUG - VMI 61eb83c2-ce1b-11ef-9236-fa163eda53e7 is active in agent 10.0.0.46 2025-01-08 23:50:59,096 - INFO - Verified Pod ctest-pod-13645571 in agent 10.0.0.46 2025-01-08 23:50:59,097 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=01796129-44af-4ecc-9f3a-875515526df8 2025-01-08 23:50:59,102 - INFO - Pod ctest-pod-13645571 with uuid 01796129-44af-4ecc-9f3a-875515526df8 found in kube manager 2025-01-08 23:50:59,102 - INFO - Pod ctest-pod-13645571 verification passed 2025-01-08 23:50:59,108 - INFO - Pod ctest-pod-03837081 is in running state.Got IP 10.47.255.248 2025-01-08 23:50:59,164 - DEBUG - Pod ctest-pod-03837081 has vmi 62759922-ce1b-11ef-9236-fa163eda53e7 2025-01-08 23:50:59,165 - INFO - Verified pod ctest-pod-03837081 in contrail-api 2025-01-08 23:50:59,181 - DEBUG - VMI 62759922-ce1b-11ef-9236-fa163eda53e7 is active in agent 10.0.0.46 2025-01-08 23:50:59,182 - INFO - Verified Pod ctest-pod-03837081 in agent 10.0.0.46 2025-01-08 23:50:59,182 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=c1644bec-4fc5-4964-9ab4-f8b1796146d1 2025-01-08 23:50:59,187 - INFO - Pod ctest-pod-03837081 with uuid c1644bec-4fc5-4964-9ab4-f8b1796146d1 found in kube manager 2025-01-08 23:50:59,187 - INFO - Pod ctest-pod-03837081 verification passed 2025-01-08 23:50:59,193 - DEBUG - Pod ctest-pod-75938134 not in running state.Currently in Pending 2025-01-08 23:51:04,203 - INFO - Pod ctest-pod-75938134 is in running state.Got IP 10.47.255.247 2025-01-08 23:51:04,235 - DEBUG - Pod ctest-pod-75938134 has vmi 630f0378-ce1b-11ef-9236-fa163eda53e7 2025-01-08 23:51:04,235 - INFO - Verified pod ctest-pod-75938134 in contrail-api 2025-01-08 23:51:04,256 - DEBUG - VMI 630f0378-ce1b-11ef-9236-fa163eda53e7 is active in agent 10.0.0.46 2025-01-08 23:51:04,257 - INFO - Verified Pod ctest-pod-75938134 in agent 10.0.0.46 2025-01-08 23:51:04,257 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=baba0be5-f49b-4e1b-9c29-c55d3860da5d 2025-01-08 23:51:04,263 - INFO - Pod ctest-pod-75938134 with uuid baba0be5-f49b-4e1b-9c29-c55d3860da5d found in kube manager 2025-01-08 23:51:04,263 - INFO - Pod ctest-pod-75938134 verification passed 2025-01-08 23:51:04,272 - INFO - Pod ctest-pod-65478719 is in running state.Got IP 10.47.255.245 2025-01-08 23:51:04,291 - DEBUG - Pod ctest-pod-65478719 has vmi 64400e86-ce1b-11ef-9236-fa163eda53e7 2025-01-08 23:51:04,291 - INFO - Verified pod ctest-pod-65478719 in contrail-api 2025-01-08 23:51:04,308 - DEBUG - VMI 64400e86-ce1b-11ef-9236-fa163eda53e7 is active in agent 10.0.0.46 2025-01-08 23:51:04,309 - INFO - Verified Pod ctest-pod-65478719 in agent 10.0.0.46 2025-01-08 23:51:04,309 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=78efcff5-b51f-4734-baff-b6f28688e4e1 2025-01-08 23:51:04,315 - INFO - Pod ctest-pod-65478719 with uuid 78efcff5-b51f-4734-baff-b6f28688e4e1 found in kube manager 2025-01-08 23:51:04,315 - INFO - Pod ctest-pod-65478719 verification passed 2025-01-08 23:51:04,322 - INFO - Pod ctest-pod-14002571 is in running state.Got IP 10.47.255.246 2025-01-08 23:51:04,389 - DEBUG - Pod ctest-pod-14002571 has vmi 63ad3b4c-ce1b-11ef-9236-fa163eda53e7 2025-01-08 23:51:04,389 - INFO - Verified pod ctest-pod-14002571 in contrail-api 2025-01-08 23:51:04,407 - DEBUG - VMI 63ad3b4c-ce1b-11ef-9236-fa163eda53e7 is active in agent 10.0.0.46 2025-01-08 23:51:04,407 - INFO - Verified Pod ctest-pod-14002571 in agent 10.0.0.46 2025-01-08 23:51:04,407 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=58290606-72b2-447d-9dc9-d81d979f7481 2025-01-08 23:51:04,415 - INFO - Pod ctest-pod-14002571 with uuid 58290606-72b2-447d-9dc9-d81d979f7481 found in kube manager 2025-01-08 23:51:04,415 - INFO - Pod ctest-pod-14002571 verification passed 2025-01-08 23:51:04,422 - INFO - Pod ctest-pod-63618879 is in running state.Got IP 10.47.255.244 2025-01-08 23:51:04,485 - DEBUG - Pod ctest-pod-63618879 has vmi 64c80b4c-ce1b-11ef-9236-fa163eda53e7 2025-01-08 23:51:04,485 - INFO - Verified pod ctest-pod-63618879 in contrail-api 2025-01-08 23:51:04,501 - DEBUG - VMI 64c80b4c-ce1b-11ef-9236-fa163eda53e7 is active in agent 10.0.0.46 2025-01-08 23:51:04,502 - INFO - Verified Pod ctest-pod-63618879 in agent 10.0.0.46 2025-01-08 23:51:04,502 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=15400d41-e170-414c-aac9-6d8dc917e5e9 2025-01-08 23:51:04,509 - INFO - Pod ctest-pod-63618879 with uuid 15400d41-e170-414c-aac9-6d8dc917e5e9 found in kube manager 2025-01-08 23:51:04,509 - INFO - Pod ctest-pod-63618879 verification passed 2025-01-08 23:51:04,509 - INFO - ================================================================================ 2025-01-08 23:51:04,509 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-08 23:51:04,510 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-08 23:51:04,773 - DEBUG - Nothing to compare xmpp stats {'10.0.0.46': {'10.0.0.29': '0'}} with 2025-01-08 23:51:04,773 - INFO - Initial checks done. Running the testcase now 2025-01-08 23:51:04,773 - INFO - 2025-01-08 23:51:04,837 - DEBUG - [Pod ctest-pod-09146326] Cmd: echo ctest-pod-09146326 > /usr/share/nginx/html/index.html, Output: 2025-01-08 23:51:04,909 - DEBUG - [Pod ctest-pod-29096005] Cmd: echo ctest-pod-29096005 > /usr/share/nginx/html/index.html, Output: 2025-01-08 23:51:04,971 - DEBUG - [Pod ctest-pod-13645571] Cmd: echo ctest-pod-13645571 > /usr/share/nginx/html/index.html, Output: 2025-01-08 23:51:05,038 - DEBUG - [Pod ctest-pod-03837081] Cmd: echo ctest-pod-03837081 > /usr/share/nginx/html/index.html, Output: 2025-01-08 23:51:05,042 - DEBUG - Service ctest-nginx-svc-15615062 not present 2025-01-08 23:51:05,042 - INFO - Creating service ctest-nginx-svc-15615062 2025-01-08 23:51:05,071 - INFO - Created Service ctest-nginx-svc-15615062 2025-01-08 23:51:05,089 - WARNING - Service UUID 49c82614-e577-4ab9-b70f-6aae12c2ca47 not yet found in contrail-api 2025-01-08 23:51:06,097 - INFO - Validated that Service ctest-nginx-svc-15615062 is seen in contrail-api 2025-01-08 23:51:06,097 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_LoadbalancerDatabaseList?x=49c82614-e577-4ab9-b70f-6aae12c2ca47 2025-01-08 23:51:06,102 - INFO - Service ctest-nginx-svc-15615062 with uuid 49c82614-e577-4ab9-b70f-6aae12c2ca47 found in kube manager 2025-01-08 23:51:06,103 - INFO - Service ctest-nginx-svc-15615062 verification passed 2025-01-08 23:51:07,171 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29096005 2025-01-08 23:51:07,171 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:51:07,171 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29096005 2025-01-08 23:51:07,255 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:51:07,255 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:51:07,255 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:51:07,256 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09146326': 1, 'ctest-pod-29096005': 1} 2025-01-08 23:51:07,321 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-29096005 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:51:07,321 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:51:07,321 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: ctest-pod-29096005 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:51:07,399 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-29096005 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:51:07,399 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:51:07,399 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: ctest-pod-29096005 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:51:07,462 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29096005 2025-01-08 23:51:07,462 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:51:07,462 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29096005 2025-01-08 23:51:07,565 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29096005 2025-01-08 23:51:07,565 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:51:07,565 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29096005 2025-01-08 23:51:07,631 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-09146326 2025-01-08 23:51:07,631 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:51:07,631 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-09146326 2025-01-08 23:51:07,631 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09146326': 1, 'ctest-pod-29096005': 4} 2025-01-08 23:51:07,635 - DEBUG - Network policy ingress-on-service not present 2025-01-08 23:51:07,636 - INFO - Creating Network Policy ingress-on-service 2025-01-08 23:51:07,649 - INFO - Network policy found in k8s 2025-01-08 23:51:07,650 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e35efe3d-796a-4b30-b665-da28e3440065 2025-01-08 23:51:07,679 - INFO - Network Policy ingress-on-service with uuid e35efe3d-796a-4b30-b665-da28e3440065 found in kube manager 2025-01-08 23:51:07,722 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-08 23:51:07,723 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-08 23:51:07,723 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e35efe3d-796a-4b30-b665-da28e3440065 2025-01-08 23:51:07,763 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-08 23:51:09,763 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e35efe3d-796a-4b30-b665-da28e3440065 2025-01-08 23:51:09,803 - INFO - Network policy with name ingress-on-service found in agent 2025-01-08 23:51:09,803 - INFO - Network Policy ingress-on-service verification passed 2025-01-08 23:51:14,872 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:14,872 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:14,872 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:19,943 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:19,943 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:19,943 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:24,995 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:24,995 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:24,995 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:30,043 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:30,044 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:30,044 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:35,095 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:35,095 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:35,096 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:40,152 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:40,152 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:40,152 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:45,222 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:45,222 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:45,222 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:50,294 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:50,294 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:50,294 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:55,352 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:55,352 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:51:55,352 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:00,427 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:00,427 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:00,427 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:00,427 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-09146326': 0, 'ctest-pod-29096005': 0} 2025-01-08 23:52:00,513 - DEBUG - [Pod ctest-pod-14002571] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-29096005 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:52:00,513 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:52:00,513 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd output: ctest-pod-29096005 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:52:00,591 - DEBUG - [Pod ctest-pod-14002571] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:52:00,591 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:52:00,591 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:52:00,591 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09146326': 1, 'ctest-pod-29096005': 1} 2025-01-08 23:52:01,525 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-01-08 23:52:11,603 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:11,604 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:11,604 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:16,662 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:16,663 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:16,663 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:21,716 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:21,716 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:21,716 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:26,779 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:26,779 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:26,779 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:31,836 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:31,836 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:31,836 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:36,897 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:36,897 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:36,897 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:41,972 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:41,972 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:41,972 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:47,050 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:47,050 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:47,050 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:52,106 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:52,106 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:52,106 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:57,180 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:57,180 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:57,180 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:52:57,180 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-09146326': 0, 'ctest-pod-29096005': 0} 2025-01-08 23:52:59,254 - DEBUG - [Pod ctest-pod-14002571] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=2.457 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.872/2.457 ms 2025-01-08 23:52:59,254 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-14002571 with expectation True passed 2025-01-08 23:53:01,327 - DEBUG - [Pod ctest-pod-75938134] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.432 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.197/0.432 ms 2025-01-08 23:53:01,327 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-75938134 with expectation True passed 2025-01-08 23:53:03,392 - DEBUG - [Pod ctest-pod-65478719] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.208 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.455/1.208 ms 2025-01-08 23:53:03,392 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65478719 with expectation True passed 2025-01-08 23:53:03,465 - DEBUG - [Pod ctest-pod-14002571] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 23:53:03,465 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-08 23:53:03,465 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 23:53:03,465 - INFO - wget check of of http://10.47.255.251 from ctest-pod-14002571 passed 2025-01-08 23:53:03,531 - DEBUG - [Pod ctest-pod-14002571] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 23:53:03,532 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-08 23:53:03,532 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 23:53:03,532 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14002571 passed 2025-01-08 23:53:08,591 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 23:53:08,592 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 23:53:08,592 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 23:53:08,592 - INFO - wget check of of http://10.47.255.250 from ctest-pod-75938134 passed 2025-01-08 23:53:13,662 - DEBUG - [Pod ctest-pod-63618879] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-08 23:53:13,662 - DEBUG - [Pod Pod ctest-pod-63618879] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-08 23:53:13,662 - DEBUG - [Pod Pod ctest-pod-63618879] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-08 23:53:13,662 - INFO - wget check of of http://10.47.255.251 from ctest-pod-63618879 passed 2025-01-08 23:53:13,673 - INFO - Updating Network Policy ingress-on-service 2025-01-08 23:53:18,764 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:18,764 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:18,764 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:23,831 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:23,832 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:23,832 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:28,883 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:28,883 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:28,883 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:33,947 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:33,947 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:33,947 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:39,011 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:39,011 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:39,011 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:44,072 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:44,073 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:44,073 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:49,146 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:49,146 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:49,146 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:54,211 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:54,211 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:54,211 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:59,279 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:59,279 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:53:59,279 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:54:04,345 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:54:04,345 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:54:04,345 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.104.127.131:80 (10.104.127.131:80) wget: download timed out 2025-01-08 23:54:04,345 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-09146326': 0, 'ctest-pod-29096005': 0} 2025-01-08 23:54:04,411 - DEBUG - [Pod ctest-pod-14002571] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-29096005 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,411 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:54:04,411 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd output: ctest-pod-29096005 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,485 - DEBUG - [Pod ctest-pod-14002571] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,485 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:54:04,485 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,485 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09146326': 1, 'ctest-pod-29096005': 1} 2025-01-08 23:54:04,565 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,565 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:54:04,565 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,646 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,646 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:54:04,646 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,713 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,713 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:54:04,713 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: ctest-pod-09146326 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,779 - DEBUG - [Pod ctest-pod-65478719] Cmd: wget http://10.104.127.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-29096005 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,780 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd wget http://10.104.127.131:80/ -O - -T 5 -t 1 passed 2025-01-08 23:54:04,780 - DEBUG - [Pod Pod ctest-pod-65478719] Cmd output: ctest-pod-29096005 Connecting to 10.104.127.131:80 (10.104.127.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 23:54:04,780 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09146326': 3, 'ctest-pod-29096005': 1} 2025-01-08 23:54:06,847 - DEBUG - [Pod ctest-pod-14002571] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.739 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.087 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.299/0.739 ms 2025-01-08 23:54:06,847 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-14002571 with expectation True passed 2025-01-08 23:54:08,903 - DEBUG - [Pod ctest-pod-75938134] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.293 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.485/1.293 ms 2025-01-08 23:54:08,903 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-75938134 with expectation True passed 2025-01-08 23:54:10,957 - DEBUG - [Pod ctest-pod-65478719] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.639 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.272/0.639 ms 2025-01-08 23:54:10,958 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65478719 with expectation True passed 2025-01-08 23:54:11,021 - DEBUG - [Pod ctest-pod-14002571] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 23:54:11,021 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-08 23:54:11,021 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 23:54:11,021 - INFO - wget check of of http://10.47.255.251 from ctest-pod-14002571 passed 2025-01-08 23:54:11,090 - DEBUG - [Pod ctest-pod-14002571] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 23:54:11,090 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-08 23:54:11,090 - DEBUG - [Pod Pod ctest-pod-14002571] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 23:54:11,090 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14002571 passed 2025-01-08 23:54:16,159 - DEBUG - [Pod ctest-pod-75938134] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 23:54:16,159 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 23:54:16,159 - DEBUG - [Pod Pod ctest-pod-75938134] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 23:54:16,159 - INFO - wget check of of http://10.47.255.250 from ctest-pod-75938134 passed 2025-01-08 23:54:16,237 - DEBUG - [Pod ctest-pod-63618879] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 23:54:16,237 - DEBUG - [Pod Pod ctest-pod-63618879] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-08 23:54:16,237 - DEBUG - [Pod Pod ctest-pod-63618879] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 23:54:16,237 - INFO - wget check of of http://10.47.255.251 from ctest-pod-63618879 passed 2025-01-08 23:54:16,237 - INFO - Deleting Network Policy : ingress-on-service 2025-01-08 23:54:16,238 - INFO - Deleting service : ctest-nginx-svc-15615062 2025-01-08 23:54:16,511 - DEBUG - No XMPP flaps were noticed during the test 2025-01-08 23:54:16,512 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12] 2025-01-08 23:54:16,512 - INFO - -------------------------------------------------------------------------------- 2025-01-08 23:54:16,523 - INFO - Deleting pod ctest-new-default-49447188:ctest-pod-09146326 2025-01-08 23:54:16,524 - INFO - Deleting pod ctest-new-default-49447188:ctest-pod-29096005 2025-01-08 23:54:16,525 - INFO - Deleting pod ctest-non-default-83698344:ctest-pod-13645571 2025-01-08 23:54:16,525 - INFO - Deleting pod ctest-non-default-83698344:ctest-pod-03837081 2025-01-08 23:54:16,526 - INFO - Deleting pod ctest-new-default-49447188:ctest-pod-75938134 2025-01-08 23:54:16,527 - INFO - Deleting pod ctest-new-default-49447188:ctest-pod-14002571 2025-01-08 23:54:16,527 - INFO - Deleting pod ctest-non-default-83698344:ctest-pod-65478719 2025-01-08 23:54:16,528 - INFO - Deleting pod ctest-non-default-83698344:ctest-pod-63618879 2025-01-08 23:54:16,640 - WARNING - Pod uuid aa3dd657-a58a-4507-a70e-429f1c8cad09 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:16,654 - WARNING - Pod uuid baba0be5-f49b-4e1b-9c29-c55d3860da5d is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:16,657 - WARNING - Pod uuid 78efcff5-b51f-4734-baff-b6f28688e4e1 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:16,700 - WARNING - Pod uuid 58290606-72b2-447d-9dc9-d81d979f7481 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:16,702 - WARNING - Pod uuid c1644bec-4fc5-4964-9ab4-f8b1796146d1 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:16,703 - WARNING - Pod uuid d97b46a5-ad52-4f91-a8e6-50200238a516 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:16,703 - WARNING - Pod uuid 15400d41-e170-414c-aac9-6d8dc917e5e9 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:16,704 - WARNING - Pod uuid 01796129-44af-4ecc-9f3a-875515526df8 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:21,649 - DEBUG - Pod aa3dd657-a58a-4507-a70e-429f1c8cad09 is not in agent 10.0.0.46 VM list 2025-01-08 23:54:21,660 - DEBUG - VMI 607b7a38-ce1b-11ef-9236-fa163eda53e7 is removed from agent 10.0.0.46 2025-01-08 23:54:21,660 - INFO - Verified that pod ctest-pod-09146326 is removed in agent 2025-01-08 23:54:21,668 - WARNING - Pod uuid 78efcff5-b51f-4734-baff-b6f28688e4e1 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:21,669 - WARNING - Pod uuid baba0be5-f49b-4e1b-9c29-c55d3860da5d is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:21,724 - WARNING - Pod uuid 15400d41-e170-414c-aac9-6d8dc917e5e9 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:21,727 - WARNING - Pod uuid 58290606-72b2-447d-9dc9-d81d979f7481 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:21,727 - DEBUG - Pod 01796129-44af-4ecc-9f3a-875515526df8 is not in agent 10.0.0.46 VM list 2025-01-08 23:54:21,729 - WARNING - Pod uuid d97b46a5-ad52-4f91-a8e6-50200238a516 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:21,729 - DEBUG - Pod c1644bec-4fc5-4964-9ab4-f8b1796146d1 is not in agent 10.0.0.46 VM list 2025-01-08 23:54:21,739 - DEBUG - VMI 62759922-ce1b-11ef-9236-fa163eda53e7 is removed from agent 10.0.0.46 2025-01-08 23:54:21,739 - INFO - Verified that pod ctest-pod-03837081 is removed in agent 2025-01-08 23:54:21,741 - DEBUG - VMI 61eb83c2-ce1b-11ef-9236-fa163eda53e7 is removed from agent 10.0.0.46 2025-01-08 23:54:21,741 - INFO - Verified that pod ctest-pod-13645571 is removed in agent 2025-01-08 23:54:26,685 - WARNING - Pod uuid baba0be5-f49b-4e1b-9c29-c55d3860da5d is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:26,686 - WARNING - Pod uuid 78efcff5-b51f-4734-baff-b6f28688e4e1 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:26,743 - WARNING - Pod uuid 15400d41-e170-414c-aac9-6d8dc917e5e9 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:26,745 - WARNING - Pod uuid d97b46a5-ad52-4f91-a8e6-50200238a516 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:26,745 - WARNING - Pod uuid 58290606-72b2-447d-9dc9-d81d979f7481 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:31,698 - WARNING - Pod uuid baba0be5-f49b-4e1b-9c29-c55d3860da5d is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:31,699 - WARNING - Pod uuid 78efcff5-b51f-4734-baff-b6f28688e4e1 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:31,759 - WARNING - Pod uuid 15400d41-e170-414c-aac9-6d8dc917e5e9 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:31,761 - WARNING - Pod uuid 58290606-72b2-447d-9dc9-d81d979f7481 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:31,761 - WARNING - Pod uuid d97b46a5-ad52-4f91-a8e6-50200238a516 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:36,711 - WARNING - Pod uuid baba0be5-f49b-4e1b-9c29-c55d3860da5d is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:36,712 - WARNING - Pod uuid 78efcff5-b51f-4734-baff-b6f28688e4e1 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:36,775 - WARNING - Pod uuid 15400d41-e170-414c-aac9-6d8dc917e5e9 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:36,777 - WARNING - Pod uuid d97b46a5-ad52-4f91-a8e6-50200238a516 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:36,777 - WARNING - Pod uuid 58290606-72b2-447d-9dc9-d81d979f7481 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:41,723 - WARNING - Pod uuid baba0be5-f49b-4e1b-9c29-c55d3860da5d is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:41,724 - WARNING - Pod uuid 78efcff5-b51f-4734-baff-b6f28688e4e1 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:41,792 - WARNING - Pod uuid 15400d41-e170-414c-aac9-6d8dc917e5e9 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:41,794 - WARNING - Pod uuid d97b46a5-ad52-4f91-a8e6-50200238a516 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:41,795 - WARNING - Pod uuid 58290606-72b2-447d-9dc9-d81d979f7481 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:46,757 - WARNING - Pod uuid baba0be5-f49b-4e1b-9c29-c55d3860da5d is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:46,758 - WARNING - Pod uuid 78efcff5-b51f-4734-baff-b6f28688e4e1 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:46,815 - WARNING - Pod uuid 15400d41-e170-414c-aac9-6d8dc917e5e9 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:46,819 - WARNING - Pod uuid d97b46a5-ad52-4f91-a8e6-50200238a516 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:46,820 - WARNING - Pod uuid 58290606-72b2-447d-9dc9-d81d979f7481 is still seen in agent 10.0.0.46 VM list 2025-01-08 23:54:51,771 - DEBUG - Pod baba0be5-f49b-4e1b-9c29-c55d3860da5d is not in agent 10.0.0.46 VM list 2025-01-08 23:54:51,772 - DEBUG - Pod 78efcff5-b51f-4734-baff-b6f28688e4e1 is not in agent 10.0.0.46 VM list 2025-01-08 23:54:51,783 - DEBUG - VMI 630f0378-ce1b-11ef-9236-fa163eda53e7 is removed from agent 10.0.0.46 2025-01-08 23:54:51,783 - INFO - Verified that pod ctest-pod-75938134 is removed in agent 2025-01-08 23:54:51,784 - DEBUG - VMI 64400e86-ce1b-11ef-9236-fa163eda53e7 is removed from agent 10.0.0.46 2025-01-08 23:54:51,784 - INFO - Verified that pod ctest-pod-65478719 is removed in agent 2025-01-08 23:54:51,825 - DEBUG - Pod 15400d41-e170-414c-aac9-6d8dc917e5e9 is not in agent 10.0.0.46 VM list 2025-01-08 23:54:51,832 - DEBUG - Pod d97b46a5-ad52-4f91-a8e6-50200238a516 is not in agent 10.0.0.46 VM list 2025-01-08 23:54:51,835 - DEBUG - Pod 58290606-72b2-447d-9dc9-d81d979f7481 is not in agent 10.0.0.46 VM list 2025-01-08 23:54:51,847 - DEBUG - VMI 64c80b4c-ce1b-11ef-9236-fa163eda53e7 is removed from agent 10.0.0.46 2025-01-08 23:54:51,847 - INFO - Verified that pod ctest-pod-63618879 is removed in agent 2025-01-08 23:54:51,849 - DEBUG - VMI 61129ab2-ce1b-11ef-9236-fa163eda53e7 is removed from agent 10.0.0.46 2025-01-08 23:54:51,849 - INFO - Verified that pod ctest-pod-29096005 is removed in agent 2025-01-08 23:54:51,849 - DEBUG - VMI 63ad3b4c-ce1b-11ef-9236-fa163eda53e7 is removed from agent 10.0.0.46 2025-01-08 23:54:51,849 - INFO - Verified that pod ctest-pod-14002571 is removed in agent 2025-01-08 23:54:51,850 - INFO - Deleting namespace ctest-non-default-83698344 2025-01-08 23:54:51,870 - DEBUG - Namespace ctest-non-default-83698344 still in k8s 2025-01-08 23:54:53,878 - DEBUG - Namespace ctest-non-default-83698344 still in k8s 2025-01-08 23:54:55,885 - DEBUG - Namespace ctest-non-default-83698344 still in k8s 2025-01-08 23:54:57,890 - DEBUG - Namespace ctest-non-default-83698344 is not in k8s 2025-01-08 23:54:57,890 - DEBUG - No need to check project deletion in contrail-api 2025-01-08 23:54:57,890 - INFO - Deleting namespace ctest-new-default-49447188 2025-01-08 23:54:57,901 - DEBUG - Namespace ctest-new-default-49447188 still in k8s 2025-01-08 23:54:59,907 - DEBUG - Namespace ctest-new-default-49447188 still in k8s 2025-01-08 23:55:01,914 - DEBUG - Namespace ctest-new-default-49447188 still in k8s 2025-01-08 23:55:03,919 - DEBUG - Namespace ctest-new-default-49447188 is not in k8s 2025-01-08 23:55:03,919 - DEBUG - No need to check project deletion in contrail-api