2024-11-10 17:58:46,692 - INFO - Using existing project ['default-domain', 'k8s-default'](a80d9a94-3fdd-42dc-b9ea-5abf65da1da2) 2024-11-10 17:58:46,714 - DEBUG - Namespace ctest-new-default-08734894 not present 2024-11-10 17:58:46,727 - INFO - Created namespace ctest-new-default-08734894 2024-11-10 17:58:49,732 - DEBUG - Namespace ctest-non-default-49723863 not present 2024-11-10 17:58:49,739 - INFO - Created namespace ctest-non-default-49723863 2024-11-10 17:58:52,760 - DEBUG - Pod ctest-pod-08115045 not present 2024-11-10 17:58:52,762 - INFO - Creating Pod ctest-pod-08115045 2024-11-10 17:58:52,787 - DEBUG - Pod : ctest-pod-08115045 UUID is 8d325a22-31d8-4d7e-b752-681e3c02f6f5 2024-11-10 17:58:52,791 - DEBUG - Pod ctest-pod-56680666 not present 2024-11-10 17:58:52,791 - INFO - Creating Pod ctest-pod-56680666 2024-11-10 17:58:52,828 - DEBUG - Pod : ctest-pod-56680666 UUID is 43600005-8447-45e2-a7e4-085f25b0ede7 2024-11-10 17:58:52,831 - DEBUG - Pod ctest-pod-55633775 not present 2024-11-10 17:58:52,831 - INFO - Creating Pod ctest-pod-55633775 2024-11-10 17:58:52,863 - DEBUG - Pod : ctest-pod-55633775 UUID is 70609bb9-b962-49ca-8fa3-922ff2997f79 2024-11-10 17:58:52,879 - DEBUG - Pod ctest-pod-77454722 not present 2024-11-10 17:58:52,879 - INFO - Creating Pod ctest-pod-77454722 2024-11-10 17:58:52,906 - DEBUG - Pod : ctest-pod-77454722 UUID is a909ce21-d23e-4300-af3c-a562e4cc0712 2024-11-10 17:58:52,909 - DEBUG - Pod ctest-pod-96803653 not present 2024-11-10 17:58:52,909 - INFO - Creating Pod ctest-pod-96803653 2024-11-10 17:58:52,927 - DEBUG - Pod : ctest-pod-96803653 UUID is 9693dc0c-d1c4-4375-9760-1c6f708c7080 2024-11-10 17:58:52,929 - DEBUG - Pod ctest-pod-21610758 not present 2024-11-10 17:58:52,929 - INFO - Creating Pod ctest-pod-21610758 2024-11-10 17:58:52,948 - DEBUG - Pod : ctest-pod-21610758 UUID is 233216a7-ccad-45b6-bff5-8be4406f911a 2024-11-10 17:58:52,951 - DEBUG - Pod ctest-pod-58898817 not present 2024-11-10 17:58:52,951 - INFO - Creating Pod ctest-pod-58898817 2024-11-10 17:58:52,978 - DEBUG - Pod : ctest-pod-58898817 UUID is da2ee36f-b6ce-428a-94d1-a891f97e65ff 2024-11-10 17:58:52,981 - DEBUG - Pod ctest-pod-00768611 not present 2024-11-10 17:58:52,982 - INFO - Creating Pod ctest-pod-00768611 2024-11-10 17:58:53,008 - DEBUG - Pod : ctest-pod-00768611 UUID is 3a689445-3bdf-4671-b39b-5c0b03fad60b 2024-11-10 17:58:53,190 - INFO - Project default-domain:k8s-ctest-new-default-08734894 for Namespace ctest-new-default-08734894 is seen in contrail-api 2024-11-10 17:58:53,190 - DEBUG - Project uuid in Contrail is f77ee204-025d-41bf-a0c0-c0ed02b038b9 2024-11-10 17:58:53,330 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=1f2b730c-1ba8-4238-bce5-57d0785e6e5b 2024-11-10 17:58:53,336 - INFO - Namespace ctest-new-default-08734894 with uuid 1f2b730c-1ba8-4238-bce5-57d0785e6e5b found in kube manager 2024-11-10 17:58:53,336 - INFO - Namespace ctest-new-default-08734894 verification passed 2024-11-10 17:58:53,602 - INFO - Project default-domain:k8s-ctest-non-default-49723863 for Namespace ctest-non-default-49723863 is seen in contrail-api 2024-11-10 17:58:53,602 - DEBUG - Project uuid in Contrail is 3c6e553c-c851-49ad-8202-c0c2446833a0 2024-11-10 17:58:53,602 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=78af25fa-e5b7-43ad-a52a-b9f80feec9cc 2024-11-10 17:58:53,608 - INFO - Namespace ctest-non-default-49723863 with uuid 78af25fa-e5b7-43ad-a52a-b9f80feec9cc found in kube manager 2024-11-10 17:58:53,608 - INFO - Namespace ctest-non-default-49723863 verification passed 2024-11-10 17:58:53,615 - DEBUG - Pod ctest-pod-08115045 not in running state.Currently in Pending 2024-11-10 17:58:58,621 - DEBUG - Pod ctest-pod-08115045 not in running state.Currently in Pending 2024-11-10 17:59:03,628 - DEBUG - Pod ctest-pod-08115045 not in running state.Currently in Pending 2024-11-10 17:59:08,644 - INFO - Pod ctest-pod-08115045 is in running state.Got IP 10.47.255.251 2024-11-10 17:59:08,664 - DEBUG - Pod ctest-pod-08115045 has vmi 737ffc74-9f8d-11ef-ad33-fa163eb2d2fa 2024-11-10 17:59:08,665 - INFO - Verified pod ctest-pod-08115045 in contrail-api 2024-11-10 17:59:08,681 - DEBUG - VMI 737ffc74-9f8d-11ef-ad33-fa163eb2d2fa is active in agent 10.0.0.38 2024-11-10 17:59:08,681 - INFO - Verified Pod ctest-pod-08115045 in agent 10.0.0.38 2024-11-10 17:59:08,681 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=8d325a22-31d8-4d7e-b752-681e3c02f6f5 2024-11-10 17:59:08,686 - INFO - Pod ctest-pod-08115045 with uuid 8d325a22-31d8-4d7e-b752-681e3c02f6f5 found in kube manager 2024-11-10 17:59:08,687 - INFO - Pod ctest-pod-08115045 verification passed 2024-11-10 17:59:08,694 - INFO - Pod ctest-pod-56680666 is in running state.Got IP 10.47.255.250 2024-11-10 17:59:08,758 - DEBUG - Pod ctest-pod-56680666 has vmi 74105670-9f8d-11ef-ad33-fa163eb2d2fa 2024-11-10 17:59:08,758 - INFO - Verified pod ctest-pod-56680666 in contrail-api 2024-11-10 17:59:09,096 - DEBUG - VMI 74105670-9f8d-11ef-ad33-fa163eb2d2fa is active in agent 10.0.0.38 2024-11-10 17:59:09,097 - INFO - Verified Pod ctest-pod-56680666 in agent 10.0.0.38 2024-11-10 17:59:09,098 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=43600005-8447-45e2-a7e4-085f25b0ede7 2024-11-10 17:59:09,105 - INFO - Pod ctest-pod-56680666 with uuid 43600005-8447-45e2-a7e4-085f25b0ede7 found in kube manager 2024-11-10 17:59:09,105 - INFO - Pod ctest-pod-56680666 verification passed 2024-11-10 17:59:09,114 - INFO - Pod ctest-pod-55633775 is in running state.Got IP 10.47.255.249 2024-11-10 17:59:09,141 - DEBUG - Pod ctest-pod-55633775 has vmi 74dfdee0-9f8d-11ef-ad33-fa163eb2d2fa 2024-11-10 17:59:09,142 - INFO - Verified pod ctest-pod-55633775 in contrail-api 2024-11-10 17:59:09,160 - DEBUG - VMI 74dfdee0-9f8d-11ef-ad33-fa163eb2d2fa is active in agent 10.0.0.38 2024-11-10 17:59:09,160 - INFO - Verified Pod ctest-pod-55633775 in agent 10.0.0.38 2024-11-10 17:59:09,160 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=70609bb9-b962-49ca-8fa3-922ff2997f79 2024-11-10 17:59:09,167 - INFO - Pod ctest-pod-55633775 with uuid 70609bb9-b962-49ca-8fa3-922ff2997f79 found in kube manager 2024-11-10 17:59:09,167 - INFO - Pod ctest-pod-55633775 verification passed 2024-11-10 17:59:09,175 - INFO - Pod ctest-pod-77454722 is in running state.Got IP 10.47.255.248 2024-11-10 17:59:09,199 - DEBUG - Pod ctest-pod-77454722 has vmi 756d0db0-9f8d-11ef-ad33-fa163eb2d2fa 2024-11-10 17:59:09,199 - INFO - Verified pod ctest-pod-77454722 in contrail-api 2024-11-10 17:59:09,213 - DEBUG - VMI 756d0db0-9f8d-11ef-ad33-fa163eb2d2fa is active in agent 10.0.0.38 2024-11-10 17:59:09,213 - INFO - Verified Pod ctest-pod-77454722 in agent 10.0.0.38 2024-11-10 17:59:09,213 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=a909ce21-d23e-4300-af3c-a562e4cc0712 2024-11-10 17:59:09,220 - INFO - Pod ctest-pod-77454722 with uuid a909ce21-d23e-4300-af3c-a562e4cc0712 found in kube manager 2024-11-10 17:59:09,220 - INFO - Pod ctest-pod-77454722 verification passed 2024-11-10 17:59:09,225 - DEBUG - Pod ctest-pod-96803653 not in running state.Currently in Pending 2024-11-10 17:59:14,233 - INFO - Pod ctest-pod-96803653 is in running state.Got IP 10.47.255.247 2024-11-10 17:59:14,318 - DEBUG - Pod ctest-pod-96803653 has vmi 7610ca36-9f8d-11ef-ad33-fa163eb2d2fa 2024-11-10 17:59:14,318 - INFO - Verified pod ctest-pod-96803653 in contrail-api 2024-11-10 17:59:14,337 - DEBUG - VMI 7610ca36-9f8d-11ef-ad33-fa163eb2d2fa is active in agent 10.0.0.38 2024-11-10 17:59:14,337 - INFO - Verified Pod ctest-pod-96803653 in agent 10.0.0.38 2024-11-10 17:59:14,337 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=9693dc0c-d1c4-4375-9760-1c6f708c7080 2024-11-10 17:59:14,358 - INFO - Pod ctest-pod-96803653 with uuid 9693dc0c-d1c4-4375-9760-1c6f708c7080 found in kube manager 2024-11-10 17:59:14,358 - INFO - Pod ctest-pod-96803653 verification passed 2024-11-10 17:59:14,371 - INFO - Pod ctest-pod-58898817 is in running state.Got IP 10.47.255.245 2024-11-10 17:59:14,395 - DEBUG - Pod ctest-pod-58898817 has vmi 771b6e86-9f8d-11ef-ad33-fa163eb2d2fa 2024-11-10 17:59:14,395 - INFO - Verified pod ctest-pod-58898817 in contrail-api 2024-11-10 17:59:14,414 - DEBUG - VMI 771b6e86-9f8d-11ef-ad33-fa163eb2d2fa is active in agent 10.0.0.38 2024-11-10 17:59:14,414 - INFO - Verified Pod ctest-pod-58898817 in agent 10.0.0.38 2024-11-10 17:59:14,414 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=da2ee36f-b6ce-428a-94d1-a891f97e65ff 2024-11-10 17:59:14,420 - INFO - Pod ctest-pod-58898817 with uuid da2ee36f-b6ce-428a-94d1-a891f97e65ff found in kube manager 2024-11-10 17:59:14,420 - INFO - Pod ctest-pod-58898817 verification passed 2024-11-10 17:59:14,425 - INFO - Pod ctest-pod-21610758 is in running state.Got IP 10.47.255.246 2024-11-10 17:59:14,494 - DEBUG - Pod ctest-pod-21610758 has vmi 76948e98-9f8d-11ef-ad33-fa163eb2d2fa 2024-11-10 17:59:14,494 - INFO - Verified pod ctest-pod-21610758 in contrail-api 2024-11-10 17:59:14,652 - DEBUG - VMI 76948e98-9f8d-11ef-ad33-fa163eb2d2fa is active in agent 10.0.0.38 2024-11-10 17:59:14,652 - INFO - Verified Pod ctest-pod-21610758 in agent 10.0.0.38 2024-11-10 17:59:14,652 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=233216a7-ccad-45b6-bff5-8be4406f911a 2024-11-10 17:59:14,658 - INFO - Pod ctest-pod-21610758 with uuid 233216a7-ccad-45b6-bff5-8be4406f911a found in kube manager 2024-11-10 17:59:14,658 - INFO - Pod ctest-pod-21610758 verification passed 2024-11-10 17:59:14,665 - INFO - Pod ctest-pod-00768611 is in running state.Got IP 10.47.255.244 2024-11-10 17:59:14,692 - DEBUG - Pod ctest-pod-00768611 has vmi 779f4ac6-9f8d-11ef-ad33-fa163eb2d2fa 2024-11-10 17:59:14,692 - INFO - Verified pod ctest-pod-00768611 in contrail-api 2024-11-10 17:59:14,717 - DEBUG - VMI 779f4ac6-9f8d-11ef-ad33-fa163eb2d2fa is active in agent 10.0.0.38 2024-11-10 17:59:14,721 - INFO - Verified Pod ctest-pod-00768611 in agent 10.0.0.38 2024-11-10 17:59:14,721 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=3a689445-3bdf-4671-b39b-5c0b03fad60b 2024-11-10 17:59:14,734 - INFO - Pod ctest-pod-00768611 with uuid 3a689445-3bdf-4671-b39b-5c0b03fad60b found in kube manager 2024-11-10 17:59:14,735 - INFO - Pod ctest-pod-00768611 verification passed 2024-11-10 17:59:14,735 - INFO - ================================================================================ 2024-11-10 17:59:14,735 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-10 17:59:14,735 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-10 17:59:15,029 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.0.0.12': '0'}} with 2024-11-10 17:59:15,029 - INFO - Initial checks done. Running the testcase now 2024-11-10 17:59:15,029 - INFO - 2024-11-10 17:59:15,125 - DEBUG - [Pod ctest-pod-08115045] Cmd: echo ctest-pod-08115045 > /usr/share/nginx/html/index.html, Output: 2024-11-10 17:59:15,209 - DEBUG - [Pod ctest-pod-56680666] Cmd: echo ctest-pod-56680666 > /usr/share/nginx/html/index.html, Output: 2024-11-10 17:59:15,272 - DEBUG - [Pod ctest-pod-55633775] Cmd: echo ctest-pod-55633775 > /usr/share/nginx/html/index.html, Output: 2024-11-10 17:59:15,360 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2024-11-10 17:59:20,422 - DEBUG - [Pod ctest-pod-77454722] Cmd: echo ctest-pod-77454722 > /usr/share/nginx/html/index.html, Output: 2024-11-10 17:59:20,433 - DEBUG - Service ctest-nginx-svc-38339446 not present 2024-11-10 17:59:20,433 - INFO - Creating service ctest-nginx-svc-38339446 2024-11-10 17:59:20,460 - INFO - Created Service ctest-nginx-svc-38339446 2024-11-10 17:59:20,483 - WARNING - Service UUID 3c82c096-947c-4da1-95cd-d62b1175f522 not yet found in contrail-api 2024-11-10 17:59:21,522 - INFO - Validated that Service ctest-nginx-svc-38339446 is seen in contrail-api 2024-11-10 17:59:21,522 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=3c82c096-947c-4da1-95cd-d62b1175f522 2024-11-10 17:59:21,538 - INFO - Service ctest-nginx-svc-38339446 with uuid 3c82c096-947c-4da1-95cd-d62b1175f522 found in kube manager 2024-11-10 17:59:21,538 - INFO - Service ctest-nginx-svc-38339446 verification passed 2024-11-10 17:59:22,627 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56680666 2024-11-10 17:59:22,627 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:22,627 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56680666 2024-11-10 17:59:22,686 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:22,686 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:22,686 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:22,752 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:22,752 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:22,752 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:22,807 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:22,807 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:22,807 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:22,870 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) ctest-pod-56680666 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:22,871 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:22,871 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) ctest-pod-56680666 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:22,931 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56680666 2024-11-10 17:59:22,931 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:22,931 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56680666 2024-11-10 17:59:22,998 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:22,998 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:22,998 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,070 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,070 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:23,070 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,130 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56680666 2024-11-10 17:59:23,130 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:23,130 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56680666 2024-11-10 17:59:23,203 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,203 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:23,203 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,203 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-08115045': 1, 'ctest-pod-56680666': 9} 2024-11-10 17:59:23,277 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,277 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:23,277 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,341 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,341 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:23,341 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,396 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,397 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:23,397 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,448 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,449 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 17:59:23,449 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 17:59:23,449 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-08115045': 3, 'ctest-pod-56680666': 1} 2024-11-10 17:59:23,453 - DEBUG - Network policy ingress-on-service not present 2024-11-10 17:59:23,453 - INFO - Creating Network Policy ingress-on-service 2024-11-10 17:59:23,474 - INFO - Network policy found in k8s 2024-11-10 17:59:23,475 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d120e54a-0b3e-477e-b49c-dd563981b203 2024-11-10 17:59:23,495 - INFO - Network Policy ingress-on-service with uuid d120e54a-0b3e-477e-b49c-dd563981b203 found in kube manager 2024-11-10 17:59:23,584 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-10 17:59:23,584 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-10 17:59:23,584 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d120e54a-0b3e-477e-b49c-dd563981b203 2024-11-10 17:59:24,021 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-10 17:59:26,022 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d120e54a-0b3e-477e-b49c-dd563981b203 2024-11-10 17:59:26,074 - INFO - Network policy with name ingress-on-service found in agent 2024-11-10 17:59:26,075 - INFO - Network Policy ingress-on-service verification passed 2024-11-10 17:59:31,143 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:31,144 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:31,144 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:36,204 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:36,204 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:36,204 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:41,261 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:41,261 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:41,261 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:46,326 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:46,326 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:46,327 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:51,391 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:51,392 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:51,392 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:56,443 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:56,443 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 17:59:56,443 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:01,499 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:01,499 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:01,499 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:06,560 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:06,560 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:06,560 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:11,626 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:11,626 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:11,626 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:16,699 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:16,699 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:16,699 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:16,700 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-08115045': 0, 'ctest-pod-56680666': 0} 2024-11-10 18:00:16,755 - DEBUG - [Pod ctest-pod-21610758] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:00:16,755 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 18:00:16,755 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:00:16,825 - DEBUG - [Pod ctest-pod-21610758] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:00:16,826 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 18:00:16,826 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:00:16,826 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-08115045': 1, 'ctest-pod-56680666': 1} 2024-11-10 18:00:21,900 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:21,900 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:21,900 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:26,966 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:26,966 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:26,966 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:32,027 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:32,027 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:32,027 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:37,088 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:37,089 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:37,089 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:42,164 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:42,164 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:42,164 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:47,224 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:47,224 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:47,224 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:52,277 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:52,277 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:52,277 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:57,340 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:57,340 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:00:57,340 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:02,401 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:02,401 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:02,401 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:07,459 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:07,459 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:07,459 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:07,459 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-08115045': 0, 'ctest-pod-56680666': 0} 2024-11-10 18:01:09,511 - DEBUG - [Pod ctest-pod-21610758] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.214 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.070 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.451/1.214 ms 2024-11-10 18:01:09,511 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-21610758 with expectation True passed 2024-11-10 18:01:11,567 - DEBUG - [Pod ctest-pod-96803653] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.588 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.070 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.238/0.588 ms 2024-11-10 18:01:11,567 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-96803653 with expectation True passed 2024-11-10 18:01:13,619 - DEBUG - [Pod ctest-pod-58898817] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.996 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.387/0.996 ms 2024-11-10 18:01:13,619 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-58898817 with expectation True passed 2024-11-10 18:01:13,681 - DEBUG - [Pod ctest-pod-21610758] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 18:01:13,682 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 18:01:13,682 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 18:01:13,682 - INFO - wget check of of http://10.47.255.251 from ctest-pod-21610758 passed 2024-11-10 18:01:13,756 - DEBUG - [Pod ctest-pod-21610758] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 18:01:13,756 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-10 18:01:13,756 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 18:01:13,756 - INFO - wget check of of http://10.47.255.250 from ctest-pod-21610758 passed 2024-11-10 18:01:18,820 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 18:01:18,820 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 18:01:18,820 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 18:01:18,821 - INFO - wget check of of http://10.47.255.250 from ctest-pod-96803653 passed 2024-11-10 18:01:23,885 - DEBUG - [Pod ctest-pod-00768611] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 18:01:23,885 - DEBUG - [Pod Pod ctest-pod-00768611] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 18:01:23,885 - DEBUG - [Pod Pod ctest-pod-00768611] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 18:01:23,885 - INFO - wget check of of http://10.47.255.251 from ctest-pod-00768611 passed 2024-11-10 18:01:23,897 - INFO - Updating Network Policy ingress-on-service 2024-11-10 18:01:28,969 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:28,969 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:28,969 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:34,036 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:34,036 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:34,036 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:39,079 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:39,079 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:39,079 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:44,133 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:44,133 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:44,133 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:49,184 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:49,184 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:49,184 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:54,239 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:54,239 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:54,240 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:59,294 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:59,294 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:01:59,294 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:02:04,363 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:02:04,363 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:02:04,363 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:02:09,422 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:02:09,422 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:02:09,422 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:02:14,495 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:02:14,495 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:02:14,496 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.108.251.90:80 (10.108.251.90:80) wget: download timed out 2024-11-10 18:02:14,496 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-08115045': 0, 'ctest-pod-56680666': 0} 2024-11-10 18:02:14,555 - DEBUG - [Pod ctest-pod-21610758] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:02:14,556 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 18:02:14,556 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:02:14,614 - DEBUG - [Pod ctest-pod-21610758] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:02:14,614 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 18:02:14,614 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:02:14,614 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-08115045': 1, 'ctest-pod-56680666': 1} 2024-11-10 18:02:14,673 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:02:14,673 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 18:02:14,673 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: ctest-pod-56680666 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:02:14,739 - DEBUG - [Pod ctest-pod-58898817] Cmd: wget http://10.108.251.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:02:14,740 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd wget http://10.108.251.90:80/ -O - -T 5 -t 1 passed 2024-11-10 18:02:14,740 - DEBUG - [Pod Pod ctest-pod-58898817] Cmd output: ctest-pod-08115045 Connecting to 10.108.251.90:80 (10.108.251.90:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 18:02:14,740 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-08115045': 1, 'ctest-pod-56680666': 1} 2024-11-10 18:02:16,787 - DEBUG - [Pod ctest-pod-21610758] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.539 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.230/0.539 ms 2024-11-10 18:02:16,787 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-21610758 with expectation True passed 2024-11-10 18:02:18,844 - DEBUG - [Pod ctest-pod-96803653] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.676 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.278/0.676 ms 2024-11-10 18:02:18,844 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-96803653 with expectation True passed 2024-11-10 18:02:21,318 - DEBUG - [Pod ctest-pod-58898817] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.046 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.395/1.046 ms 2024-11-10 18:02:21,318 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-58898817 with expectation True passed 2024-11-10 18:02:21,376 - DEBUG - [Pod ctest-pod-21610758] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 18:02:21,377 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 18:02:21,377 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 18:02:21,377 - INFO - wget check of of http://10.47.255.251 from ctest-pod-21610758 passed 2024-11-10 18:02:21,428 - DEBUG - [Pod ctest-pod-21610758] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 18:02:21,428 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-10 18:02:21,429 - DEBUG - [Pod Pod ctest-pod-21610758] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 18:02:21,429 - INFO - wget check of of http://10.47.255.250 from ctest-pod-21610758 passed 2024-11-10 18:02:26,483 - DEBUG - [Pod ctest-pod-96803653] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 18:02:26,484 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 18:02:26,484 - DEBUG - [Pod Pod ctest-pod-96803653] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 18:02:26,484 - INFO - wget check of of http://10.47.255.250 from ctest-pod-96803653 passed 2024-11-10 18:02:26,549 - DEBUG - [Pod ctest-pod-00768611] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 18:02:26,550 - DEBUG - [Pod Pod ctest-pod-00768611] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 18:02:26,550 - DEBUG - [Pod Pod ctest-pod-00768611] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 18:02:26,550 - INFO - wget check of of http://10.47.255.251 from ctest-pod-00768611 passed 2024-11-10 18:02:26,550 - INFO - Deleting Network Policy : ingress-on-service 2024-11-10 18:02:26,550 - INFO - Deleting service : ctest-nginx-svc-38339446 2024-11-10 18:02:26,772 - DEBUG - No XMPP flaps were noticed during the test 2024-11-10 18:02:26,773 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12] 2024-11-10 18:02:26,773 - INFO - -------------------------------------------------------------------------------- 2024-11-10 18:02:26,778 - INFO - Deleting pod ctest-new-default-08734894:ctest-pod-08115045 2024-11-10 18:02:26,779 - INFO - Deleting pod ctest-new-default-08734894:ctest-pod-56680666 2024-11-10 18:02:26,779 - INFO - Deleting pod ctest-non-default-49723863:ctest-pod-55633775 2024-11-10 18:02:26,780 - INFO - Deleting pod ctest-non-default-49723863:ctest-pod-77454722 2024-11-10 18:02:26,780 - INFO - Deleting pod ctest-new-default-08734894:ctest-pod-96803653 2024-11-10 18:02:26,780 - INFO - Deleting pod ctest-new-default-08734894:ctest-pod-21610758 2024-11-10 18:02:26,781 - INFO - Deleting pod ctest-non-default-49723863:ctest-pod-58898817 2024-11-10 18:02:26,781 - INFO - Deleting pod ctest-non-default-49723863:ctest-pod-00768611 2024-11-10 18:02:26,896 - WARNING - Pod uuid 8d325a22-31d8-4d7e-b752-681e3c02f6f5 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:26,897 - WARNING - Pod uuid da2ee36f-b6ce-428a-94d1-a891f97e65ff is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:26,949 - WARNING - Pod uuid 70609bb9-b962-49ca-8fa3-922ff2997f79 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:26,950 - WARNING - Pod uuid 43600005-8447-45e2-a7e4-085f25b0ede7 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:26,951 - WARNING - Pod uuid a909ce21-d23e-4300-af3c-a562e4cc0712 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:26,951 - WARNING - Pod uuid 233216a7-ccad-45b6-bff5-8be4406f911a is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:26,952 - WARNING - Pod uuid 3a689445-3bdf-4671-b39b-5c0b03fad60b is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:26,952 - WARNING - Pod uuid 9693dc0c-d1c4-4375-9760-1c6f708c7080 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:31,908 - WARNING - Pod uuid da2ee36f-b6ce-428a-94d1-a891f97e65ff is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:31,909 - DEBUG - Pod 8d325a22-31d8-4d7e-b752-681e3c02f6f5 is not in agent 10.0.0.38 VM list 2024-11-10 18:02:31,915 - DEBUG - VMI 737ffc74-9f8d-11ef-ad33-fa163eb2d2fa is removed from agent 10.0.0.38 2024-11-10 18:02:31,915 - INFO - Verified that pod ctest-pod-08115045 is removed in agent 2024-11-10 18:02:31,972 - DEBUG - Pod 43600005-8447-45e2-a7e4-085f25b0ede7 is not in agent 10.0.0.38 VM list 2024-11-10 18:02:31,974 - DEBUG - Pod 70609bb9-b962-49ca-8fa3-922ff2997f79 is not in agent 10.0.0.38 VM list 2024-11-10 18:02:31,977 - WARNING - Pod uuid 9693dc0c-d1c4-4375-9760-1c6f708c7080 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:31,978 - WARNING - Pod uuid 3a689445-3bdf-4671-b39b-5c0b03fad60b is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:31,978 - DEBUG - Pod a909ce21-d23e-4300-af3c-a562e4cc0712 is not in agent 10.0.0.38 VM list 2024-11-10 18:02:31,987 - DEBUG - VMI 74105670-9f8d-11ef-ad33-fa163eb2d2fa is removed from agent 10.0.0.38 2024-11-10 18:02:31,987 - INFO - Verified that pod ctest-pod-56680666 is removed in agent 2024-11-10 18:02:31,989 - DEBUG - VMI 74dfdee0-9f8d-11ef-ad33-fa163eb2d2fa is removed from agent 10.0.0.38 2024-11-10 18:02:31,989 - INFO - Verified that pod ctest-pod-55633775 is removed in agent 2024-11-10 18:02:31,989 - DEBUG - VMI 756d0db0-9f8d-11ef-ad33-fa163eb2d2fa is removed from agent 10.0.0.38 2024-11-10 18:02:31,989 - INFO - Verified that pod ctest-pod-77454722 is removed in agent 2024-11-10 18:02:32,773 - WARNING - Pod uuid 233216a7-ccad-45b6-bff5-8be4406f911a is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:36,917 - WARNING - Pod uuid da2ee36f-b6ce-428a-94d1-a891f97e65ff is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:36,989 - WARNING - Pod uuid 9693dc0c-d1c4-4375-9760-1c6f708c7080 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:36,990 - WARNING - Pod uuid 3a689445-3bdf-4671-b39b-5c0b03fad60b is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:37,782 - WARNING - Pod uuid 233216a7-ccad-45b6-bff5-8be4406f911a is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:41,925 - WARNING - Pod uuid da2ee36f-b6ce-428a-94d1-a891f97e65ff is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:42,005 - WARNING - Pod uuid 9693dc0c-d1c4-4375-9760-1c6f708c7080 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:42,006 - WARNING - Pod uuid 3a689445-3bdf-4671-b39b-5c0b03fad60b is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:42,791 - WARNING - Pod uuid 233216a7-ccad-45b6-bff5-8be4406f911a is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:46,934 - WARNING - Pod uuid da2ee36f-b6ce-428a-94d1-a891f97e65ff is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:47,017 - WARNING - Pod uuid 9693dc0c-d1c4-4375-9760-1c6f708c7080 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:47,018 - WARNING - Pod uuid 3a689445-3bdf-4671-b39b-5c0b03fad60b is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:47,800 - WARNING - Pod uuid 233216a7-ccad-45b6-bff5-8be4406f911a is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:51,942 - WARNING - Pod uuid da2ee36f-b6ce-428a-94d1-a891f97e65ff is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:52,030 - WARNING - Pod uuid 3a689445-3bdf-4671-b39b-5c0b03fad60b is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:52,031 - WARNING - Pod uuid 9693dc0c-d1c4-4375-9760-1c6f708c7080 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:52,810 - WARNING - Pod uuid 233216a7-ccad-45b6-bff5-8be4406f911a is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:56,951 - WARNING - Pod uuid da2ee36f-b6ce-428a-94d1-a891f97e65ff is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:57,043 - WARNING - Pod uuid 9693dc0c-d1c4-4375-9760-1c6f708c7080 is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:57,044 - WARNING - Pod uuid 3a689445-3bdf-4671-b39b-5c0b03fad60b is still seen in agent 10.0.0.38 VM list 2024-11-10 18:02:57,819 - WARNING - Pod uuid 233216a7-ccad-45b6-bff5-8be4406f911a is still seen in agent 10.0.0.38 VM list 2024-11-10 18:03:01,960 - DEBUG - Pod da2ee36f-b6ce-428a-94d1-a891f97e65ff is not in agent 10.0.0.38 VM list 2024-11-10 18:03:01,966 - DEBUG - VMI 771b6e86-9f8d-11ef-ad33-fa163eb2d2fa is removed from agent 10.0.0.38 2024-11-10 18:03:01,966 - INFO - Verified that pod ctest-pod-58898817 is removed in agent 2024-11-10 18:03:02,056 - DEBUG - Pod 9693dc0c-d1c4-4375-9760-1c6f708c7080 is not in agent 10.0.0.38 VM list 2024-11-10 18:03:02,058 - DEBUG - Pod 3a689445-3bdf-4671-b39b-5c0b03fad60b is not in agent 10.0.0.38 VM list 2024-11-10 18:03:02,069 - DEBUG - VMI 779f4ac6-9f8d-11ef-ad33-fa163eb2d2fa is removed from agent 10.0.0.38 2024-11-10 18:03:02,069 - INFO - Verified that pod ctest-pod-00768611 is removed in agent 2024-11-10 18:03:02,071 - DEBUG - VMI 7610ca36-9f8d-11ef-ad33-fa163eb2d2fa is removed from agent 10.0.0.38 2024-11-10 18:03:02,071 - INFO - Verified that pod ctest-pod-96803653 is removed in agent 2024-11-10 18:03:02,828 - DEBUG - Pod 233216a7-ccad-45b6-bff5-8be4406f911a is not in agent 10.0.0.38 VM list 2024-11-10 18:03:02,835 - DEBUG - VMI 76948e98-9f8d-11ef-ad33-fa163eb2d2fa is removed from agent 10.0.0.38 2024-11-10 18:03:02,835 - INFO - Verified that pod ctest-pod-21610758 is removed in agent 2024-11-10 18:03:02,835 - INFO - Deleting namespace ctest-non-default-49723863 2024-11-10 18:03:02,846 - DEBUG - Namespace ctest-non-default-49723863 still in k8s 2024-11-10 18:03:04,850 - DEBUG - Namespace ctest-non-default-49723863 still in k8s 2024-11-10 18:03:06,855 - DEBUG - Namespace ctest-non-default-49723863 still in k8s 2024-11-10 18:03:08,860 - DEBUG - Namespace ctest-non-default-49723863 is not in k8s 2024-11-10 18:03:08,861 - DEBUG - No need to check project deletion in contrail-api 2024-11-10 18:03:08,861 - INFO - Deleting namespace ctest-new-default-08734894 2024-11-10 18:03:08,874 - DEBUG - Namespace ctest-new-default-08734894 still in k8s 2024-11-10 18:03:10,880 - DEBUG - Namespace ctest-new-default-08734894 still in k8s 2024-11-10 18:03:12,885 - DEBUG - Namespace ctest-new-default-08734894 still in k8s 2024-11-10 18:03:14,889 - DEBUG - Namespace ctest-new-default-08734894 is not in k8s 2024-11-10 18:03:14,889 - DEBUG - No need to check project deletion in contrail-api