2024-11-10 21:50:01,824 - INFO - Using existing project ['default-domain', 'k8s-default'](aa8dc3e7-61a7-4f87-97a4-e4537a2644a4)
2024-11-10 21:50:01,849 - DEBUG - Namespace ctest-new-default-76902101 not present
2024-11-10 21:50:01,859 - INFO - Created namespace ctest-new-default-76902101
2024-11-10 21:50:04,864 - DEBUG - Namespace ctest-non-default-52897091 not present
2024-11-10 21:50:04,880 - INFO - Created namespace ctest-non-default-52897091
2024-11-10 21:50:07,907 - DEBUG - Pod ctest-pod-35331865 not present
2024-11-10 21:50:07,908 - INFO - Creating Pod ctest-pod-35331865
2024-11-10 21:50:07,934 - DEBUG - Pod : ctest-pod-35331865 UUID is d6be87bf-e4a2-4ce1-930e-f20c76f601f9
2024-11-10 21:50:07,940 - DEBUG - Pod ctest-pod-20888622 not present
2024-11-10 21:50:07,940 - INFO - Creating Pod ctest-pod-20888622
2024-11-10 21:50:07,984 - DEBUG - Pod : ctest-pod-20888622 UUID is dfeb9225-94a5-4666-8510-9318a813cf65
2024-11-10 21:50:07,988 - DEBUG - Pod ctest-pod-04667387 not present
2024-11-10 21:50:07,988 - INFO - Creating Pod ctest-pod-04667387
2024-11-10 21:50:08,038 - DEBUG - Pod : ctest-pod-04667387 UUID is 74213849-91be-4aa1-b5d1-23feac0526df
2024-11-10 21:50:08,044 - DEBUG - Pod ctest-pod-68048326 not present
2024-11-10 21:50:08,046 - INFO - Creating Pod ctest-pod-68048326
2024-11-10 21:50:08,070 - DEBUG - Pod : ctest-pod-68048326 UUID is 55093aec-7f99-400f-b686-6f873428a888
2024-11-10 21:50:08,076 - DEBUG - Pod ctest-pod-71377017 not present
2024-11-10 21:50:08,076 - INFO - Creating Pod ctest-pod-71377017
2024-11-10 21:50:08,099 - DEBUG - Pod : ctest-pod-71377017 UUID is 946b48f4-9a10-420f-a2bf-ff152bb2909c
2024-11-10 21:50:08,101 - DEBUG - Pod ctest-pod-92921544 not present
2024-11-10 21:50:08,101 - INFO - Creating Pod ctest-pod-92921544
2024-11-10 21:50:08,120 - DEBUG - Pod : ctest-pod-92921544 UUID is b6c31725-6407-4f16-88bd-e88368d4fecb
2024-11-10 21:50:08,123 - DEBUG - Pod ctest-pod-18921688 not present
2024-11-10 21:50:08,123 - INFO - Creating Pod ctest-pod-18921688
2024-11-10 21:50:08,146 - DEBUG - Pod : ctest-pod-18921688 UUID is fc857a67-f605-4e47-a7ab-4d2ec38981dc
2024-11-10 21:50:08,149 - DEBUG - Pod ctest-pod-82900706 not present
2024-11-10 21:50:08,149 - INFO - Creating Pod ctest-pod-82900706
2024-11-10 21:50:08,174 - DEBUG - Pod : ctest-pod-82900706 UUID is f85ded9d-2784-4106-8a4c-62624fdbd409
2024-11-10 21:50:08,407 - INFO - Project default-domain:k8s-ctest-new-default-76902101 for Namespace ctest-new-default-76902101 is seen in contrail-api
2024-11-10 21:50:08,407 - DEBUG - Project uuid in Contrail is 56201ce5-cc38-4f87-8fdf-47dd77fe398d
2024-11-10 21:50:08,559 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=9204ba7d-7555-49d9-8cc0-d146c582caf7
2024-11-10 21:50:08,564 - INFO - Namespace ctest-new-default-76902101 with uuid 9204ba7d-7555-49d9-8cc0-d146c582caf7 found in kube manager
2024-11-10 21:50:08,565 - INFO - Namespace ctest-new-default-76902101 verification passed
2024-11-10 21:50:08,888 - INFO - Project default-domain:k8s-ctest-non-default-52897091 for Namespace ctest-non-default-52897091 is seen in contrail-api
2024-11-10 21:50:08,888 - DEBUG - Project uuid in Contrail is c37d163a-87cb-4d49-a865-678a3ef5cb16
2024-11-10 21:50:08,888 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=e968e281-8e98-484b-bde4-7ecd16800eab
2024-11-10 21:50:08,898 - INFO - Namespace ctest-non-default-52897091 with uuid e968e281-8e98-484b-bde4-7ecd16800eab found in kube manager
2024-11-10 21:50:08,898 - INFO - Namespace ctest-non-default-52897091 verification passed
2024-11-10 21:50:08,905 - DEBUG - Pod ctest-pod-35331865 not in running state.Currently in Pending
2024-11-10 21:50:13,923 - DEBUG - Pod ctest-pod-35331865 not in running state.Currently in Pending
2024-11-10 21:50:18,929 - DEBUG - Pod ctest-pod-35331865 not in running state.Currently in Pending
2024-11-10 21:50:23,945 - INFO - Pod ctest-pod-35331865 is in running state.Got IP 10.47.255.251
2024-11-10 21:50:23,967 - DEBUG - Pod ctest-pod-35331865 has vmi c1d7d1b0-9fad-11ef-b47f-fa163e7a64e6
2024-11-10 21:50:23,968 - INFO - Verified pod ctest-pod-35331865 in contrail-api
2024-11-10 21:50:24,005 - DEBUG - VMI c1d7d1b0-9fad-11ef-b47f-fa163e7a64e6 is active in agent 10.0.0.43
2024-11-10 21:50:24,005 - INFO - Verified Pod ctest-pod-35331865 in agent 10.0.0.43
2024-11-10 21:50:24,006 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=d6be87bf-e4a2-4ce1-930e-f20c76f601f9
2024-11-10 21:50:24,015 - INFO - Pod ctest-pod-35331865 with uuid d6be87bf-e4a2-4ce1-930e-f20c76f601f9 found in kube manager
2024-11-10 21:50:24,015 - INFO - Pod ctest-pod-35331865 verification passed
2024-11-10 21:50:24,022 - INFO - Pod ctest-pod-20888622 is in running state.Got IP 10.47.255.250
2024-11-10 21:50:24,049 - DEBUG - Pod ctest-pod-20888622 has vmi c2744630-9fad-11ef-b47f-fa163e7a64e6
2024-11-10 21:50:24,049 - INFO - Verified pod ctest-pod-20888622 in contrail-api
2024-11-10 21:50:24,094 - DEBUG - VMI c2744630-9fad-11ef-b47f-fa163e7a64e6 is active in agent 10.0.0.43
2024-11-10 21:50:24,094 - INFO - Verified Pod ctest-pod-20888622 in agent 10.0.0.43
2024-11-10 21:50:24,095 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=dfeb9225-94a5-4666-8510-9318a813cf65
2024-11-10 21:50:24,110 - INFO - Pod ctest-pod-20888622 with uuid dfeb9225-94a5-4666-8510-9318a813cf65 found in kube manager
2024-11-10 21:50:24,110 - INFO - Pod ctest-pod-20888622 verification passed
2024-11-10 21:50:24,119 - INFO - Pod ctest-pod-04667387 is in running state.Got IP 10.47.255.249
2024-11-10 21:50:24,200 - DEBUG - Pod ctest-pod-04667387 has vmi c34f1ea4-9fad-11ef-b47f-fa163e7a64e6
2024-11-10 21:50:24,200 - INFO - Verified pod ctest-pod-04667387 in contrail-api
2024-11-10 21:50:24,233 - DEBUG - VMI c34f1ea4-9fad-11ef-b47f-fa163e7a64e6 is active in agent 10.0.0.43
2024-11-10 21:50:24,234 - INFO - Verified Pod ctest-pod-04667387 in agent 10.0.0.43
2024-11-10 21:50:24,234 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=74213849-91be-4aa1-b5d1-23feac0526df
2024-11-10 21:50:24,240 - INFO - Pod ctest-pod-04667387 with uuid 74213849-91be-4aa1-b5d1-23feac0526df found in kube manager
2024-11-10 21:50:24,240 - INFO - Pod ctest-pod-04667387 verification passed
2024-11-10 21:50:24,248 - DEBUG - Pod ctest-pod-68048326 not in running state.Currently in Pending
2024-11-10 21:50:29,255 - INFO - Pod ctest-pod-68048326 is in running state.Got IP 10.47.255.248
2024-11-10 21:50:29,276 - DEBUG - Pod ctest-pod-68048326 has vmi c3e83580-9fad-11ef-b47f-fa163e7a64e6
2024-11-10 21:50:29,276 - INFO - Verified pod ctest-pod-68048326 in contrail-api
2024-11-10 21:50:29,306 - DEBUG - VMI c3e83580-9fad-11ef-b47f-fa163e7a64e6 is active in agent 10.0.0.43
2024-11-10 21:50:29,307 - INFO - Verified Pod ctest-pod-68048326 in agent 10.0.0.43
2024-11-10 21:50:29,307 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=55093aec-7f99-400f-b686-6f873428a888
2024-11-10 21:50:29,331 - INFO - Pod ctest-pod-68048326 with uuid 55093aec-7f99-400f-b686-6f873428a888 found in kube manager
2024-11-10 21:50:29,331 - INFO - Pod ctest-pod-68048326 verification passed
2024-11-10 21:50:29,343 - INFO - Pod ctest-pod-71377017 is in running state.Got IP 10.47.255.247
2024-11-10 21:50:29,375 - DEBUG - Pod ctest-pod-71377017 has vmi c4a1aace-9fad-11ef-b47f-fa163e7a64e6
2024-11-10 21:50:29,375 - INFO - Verified pod ctest-pod-71377017 in contrail-api
2024-11-10 21:50:29,400 - DEBUG - VMI c4a1aace-9fad-11ef-b47f-fa163e7a64e6 is active in agent 10.0.0.43
2024-11-10 21:50:29,400 - INFO - Verified Pod ctest-pod-71377017 in agent 10.0.0.43
2024-11-10 21:50:29,400 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=946b48f4-9a10-420f-a2bf-ff152bb2909c
2024-11-10 21:50:29,409 - INFO - Pod ctest-pod-71377017 with uuid 946b48f4-9a10-420f-a2bf-ff152bb2909c found in kube manager
2024-11-10 21:50:29,410 - INFO - Pod ctest-pod-71377017 verification passed
2024-11-10 21:50:29,421 - INFO - Pod ctest-pod-18921688 is in running state.Got IP 10.47.255.245
2024-11-10 21:50:29,504 - DEBUG - Pod ctest-pod-18921688 has vmi c5ee461c-9fad-11ef-b47f-fa163e7a64e6
2024-11-10 21:50:29,505 - INFO - Verified pod ctest-pod-18921688 in contrail-api
2024-11-10 21:50:29,548 - DEBUG - VMI c5ee461c-9fad-11ef-b47f-fa163e7a64e6 is active in agent 10.0.0.43
2024-11-10 21:50:29,549 - INFO - Verified Pod ctest-pod-18921688 in agent 10.0.0.43
2024-11-10 21:50:29,549 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=fc857a67-f605-4e47-a7ab-4d2ec38981dc
2024-11-10 21:50:29,556 - INFO - Pod ctest-pod-18921688 with uuid fc857a67-f605-4e47-a7ab-4d2ec38981dc found in kube manager
2024-11-10 21:50:29,556 - INFO - Pod ctest-pod-18921688 verification passed
2024-11-10 21:50:29,562 - INFO - Pod ctest-pod-92921544 is in running state.Got IP 10.47.255.246
2024-11-10 21:50:29,591 - DEBUG - Pod ctest-pod-92921544 has vmi c53ccffe-9fad-11ef-b47f-fa163e7a64e6
2024-11-10 21:50:29,592 - INFO - Verified pod ctest-pod-92921544 in contrail-api
2024-11-10 21:50:29,622 - DEBUG - VMI c53ccffe-9fad-11ef-b47f-fa163e7a64e6 is active in agent 10.0.0.43
2024-11-10 21:50:29,622 - INFO - Verified Pod ctest-pod-92921544 in agent 10.0.0.43
2024-11-10 21:50:29,622 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=b6c31725-6407-4f16-88bd-e88368d4fecb
2024-11-10 21:50:29,628 - INFO - Pod ctest-pod-92921544 with uuid b6c31725-6407-4f16-88bd-e88368d4fecb found in kube manager
2024-11-10 21:50:29,628 - INFO - Pod ctest-pod-92921544 verification passed
2024-11-10 21:50:29,634 - INFO - Pod ctest-pod-82900706 is in running state.Got IP 10.47.255.244
2024-11-10 21:50:29,659 - DEBUG - Pod ctest-pod-82900706 has vmi c6850aac-9fad-11ef-b47f-fa163e7a64e6
2024-11-10 21:50:29,659 - INFO - Verified pod ctest-pod-82900706 in contrail-api
2024-11-10 21:50:29,692 - DEBUG - VMI c6850aac-9fad-11ef-b47f-fa163e7a64e6 is active in agent 10.0.0.43
2024-11-10 21:50:29,693 - INFO - Verified Pod ctest-pod-82900706 in agent 10.0.0.43
2024-11-10 21:50:29,693 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=f85ded9d-2784-4106-8a4c-62624fdbd409
2024-11-10 21:50:29,698 - INFO - Pod ctest-pod-82900706 with uuid f85ded9d-2784-4106-8a4c-62624fdbd409 found in kube manager
2024-11-10 21:50:29,698 - INFO - Pod ctest-pod-82900706 verification passed
2024-11-10 21:50:29,699 - INFO - ================================================================================
2024-11-10 21:50:29,699 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-11-10 21:50:29,699 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-11-10 21:50:30,042 - DEBUG - Nothing to compare xmpp stats {'10.0.0.43': {'10.0.0.27': '0'}} with
2024-11-10 21:50:30,042 - INFO - Initial checks done. Running the testcase now
2024-11-10 21:50:30,042 - INFO -
2024-11-10 21:50:30,164 - DEBUG - [Pod ctest-pod-35331865] Cmd: echo ctest-pod-35331865 > /usr/share/nginx/html/index.html, Output:
2024-11-10 21:50:30,221 - DEBUG - [Pod ctest-pod-20888622] Cmd: echo ctest-pod-20888622 > /usr/share/nginx/html/index.html, Output:
2024-11-10 21:50:30,296 - DEBUG - [Pod ctest-pod-04667387] Cmd: echo ctest-pod-04667387 > /usr/share/nginx/html/index.html, Output:
2024-11-10 21:50:30,355 - DEBUG - [Pod ctest-pod-68048326] Cmd: echo ctest-pod-68048326 > /usr/share/nginx/html/index.html, Output:
2024-11-10 21:50:30,360 - DEBUG - Service ctest-nginx-svc-18136509 not present
2024-11-10 21:50:30,360 - INFO - Creating service ctest-nginx-svc-18136509
2024-11-10 21:50:30,375 - INFO - Created Service ctest-nginx-svc-18136509
2024-11-10 21:50:30,390 - WARNING - Service UUID 5478388b-5527-4c30-9191-e0d8116a7a3d not yet found in contrail-api
2024-11-10 21:50:31,398 - INFO - Validated that Service ctest-nginx-svc-18136509 is seen in contrail-api
2024-11-10 21:50:31,398 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=5478388b-5527-4c30-9191-e0d8116a7a3d
2024-11-10 21:50:31,406 - INFO - Service ctest-nginx-svc-18136509 with uuid 5478388b-5527-4c30-9191-e0d8116a7a3d found in kube manager
2024-11-10 21:50:31,406 - INFO - Service ctest-nginx-svc-18136509 verification passed
2024-11-10 21:50:32,567 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
ctest-pod-35331865
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:50:32,567 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:50:32,567 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
ctest-pod-35331865
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:50:32,674 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20888622
2024-11-10 21:50:32,675 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:50:32,675 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20888622
2024-11-10 21:50:32,675 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35331865': 1, 'ctest-pod-20888622': 1}
2024-11-10 21:50:32,771 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
ctest-pod-35331865
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:50:32,771 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:50:32,771 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
ctest-pod-35331865
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:50:32,823 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: ctest-pod-20888622
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:50:32,823 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:50:32,823 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: ctest-pod-20888622
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:50:32,823 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35331865': 1, 'ctest-pod-20888622': 1}
2024-11-10 21:50:32,827 - DEBUG - Network policy ingress-on-service not present
2024-11-10 21:50:32,828 - INFO - Creating Network Policy ingress-on-service
2024-11-10 21:50:32,841 - INFO - Network policy found in k8s
2024-11-10 21:50:32,841 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=eb996bed-6daa-477a-af3e-d80c010b127b
2024-11-10 21:50:32,851 - INFO - Network Policy ingress-on-service with uuid eb996bed-6daa-477a-af3e-d80c010b127b found in kube manager
2024-11-10 21:50:32,900 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-11-10 21:50:32,900 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-11-10 21:50:32,901 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=eb996bed-6daa-477a-af3e-d80c010b127b
2024-11-10 21:50:32,952 - WARNING - Network policy with name ingress-on-service not found in agent
2024-11-10 21:50:34,953 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=eb996bed-6daa-477a-af3e-d80c010b127b
2024-11-10 21:50:35,013 - INFO - Network policy with name ingress-on-service found in agent
2024-11-10 21:50:35,014 - INFO - Network Policy ingress-on-service verification passed
2024-11-10 21:50:40,135 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:40,135 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:40,135 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:45,256 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:45,256 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:45,257 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:50,377 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:50,377 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:50,377 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:55,495 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:55,495 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:50:55,495 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:00,635 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:00,636 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:00,636 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:05,735 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:05,735 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:05,735 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:10,824 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:10,824 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:10,824 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:15,943 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:15,944 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:15,944 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:21,077 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:21,077 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:21,077 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:26,223 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:26,223 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:26,223 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:26,223 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-35331865': 0, 'ctest-pod-20888622': 0}
2024-11-10 21:51:26,344 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35331865
2024-11-10 21:51:26,345 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:51:26,345 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35331865
2024-11-10 21:51:26,421 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35331865
2024-11-10 21:51:26,421 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:51:26,421 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35331865
2024-11-10 21:51:26,482 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35331865
2024-11-10 21:51:26,482 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:51:26,482 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35331865
2024-11-10 21:51:26,542 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: ctest-pod-35331865
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:51:26,543 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:51:26,543 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: ctest-pod-35331865
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:51:26,602 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35331865
2024-11-10 21:51:26,603 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:51:26,603 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35331865
2024-11-10 21:51:26,660 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: ctest-pod-35331865
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:51:26,660 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:51:26,660 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: ctest-pod-35331865
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:51:26,729 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: ctest-pod-20888622
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:51:26,729 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:51:26,730 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: ctest-pod-20888622
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:51:26,730 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35331865': 6, 'ctest-pod-20888622': 1}
2024-11-10 21:51:31,797 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:31,797 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:31,797 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:36,919 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:36,919 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:36,919 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:42,039 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:42,039 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:42,039 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:47,145 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:47,145 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:47,145 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:52,265 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:52,266 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:52,266 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:57,378 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:57,378 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:51:57,378 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:02,510 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:02,510 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:02,510 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:07,605 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:07,605 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:07,605 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:12,723 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:12,723 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:12,723 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:17,817 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:17,818 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:17,818 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:17,818 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-35331865': 0, 'ctest-pod-20888622': 0}
2024-11-10 21:52:19,923 - DEBUG - [Pod ctest-pod-92921544] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.616 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.129 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.157 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.129/0.300/0.616 ms
2024-11-10 21:52:19,923 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-92921544 with expectation True passed
2024-11-10 21:52:22,057 - DEBUG - [Pod ctest-pod-71377017] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=3.073 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.131 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.164 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.131/1.122/3.073 ms
2024-11-10 21:52:22,057 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-71377017 with expectation True passed
2024-11-10 21:52:24,181 - DEBUG - [Pod ctest-pod-18921688] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=3.625 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.134 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.165 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.134/1.308/3.625 ms
2024-11-10 21:52:24,182 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18921688 with expectation True passed
2024-11-10 21:52:24,328 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 21:52:24,328 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-11-10 21:52:24,328 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 21:52:24,328 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92921544 passed
2024-11-10 21:52:24,438 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 21:52:24,439 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-11-10 21:52:24,439 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 21:52:24,439 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92921544 passed
2024-11-10 21:52:29,517 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 21:52:29,517 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 21:52:29,517 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 21:52:29,518 - INFO - wget check of of http://10.47.255.250 from ctest-pod-71377017 passed
2024-11-10 21:52:34,650 - DEBUG - [Pod ctest-pod-82900706] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-11-10 21:52:34,650 - DEBUG - [Pod Pod ctest-pod-82900706] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-11-10 21:52:34,650 - DEBUG - [Pod Pod ctest-pod-82900706] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-11-10 21:52:34,650 - INFO - wget check of of http://10.47.255.251 from ctest-pod-82900706 passed
2024-11-10 21:52:34,662 - INFO - Updating Network Policy ingress-on-service
2024-11-10 21:52:39,792 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:39,793 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:39,793 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:44,894 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:44,894 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:44,894 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:49,982 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:49,983 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:49,983 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:55,096 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:55,096 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:52:55,096 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:00,198 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:00,198 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:00,198 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:05,291 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:05,292 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:05,292 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:10,430 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:10,430 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:10,430 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:15,569 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:15,569 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:15,569 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:20,677 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:20,677 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:20,677 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:25,779 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:25,780 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:25,780 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
wget: download timed out
2024-11-10 21:53:25,780 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-35331865': 0, 'ctest-pod-20888622': 0}
2024-11-10 21:53:25,913 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: ctest-pod-35331865
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:53:25,913 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:53:25,915 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: ctest-pod-35331865
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:53:25,999 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: ctest-pod-35331865
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:53:25,999 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:53:25,999 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: ctest-pod-35331865
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:53:26,073 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20888622
2024-11-10 21:53:26,073 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:53:26,073 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20888622
2024-11-10 21:53:26,073 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35331865': 2, 'ctest-pod-20888622': 1}
2024-11-10 21:53:26,155 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: ctest-pod-20888622
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:53:26,155 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:53:26,155 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: ctest-pod-20888622
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:53:26,231 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20888622
2024-11-10 21:53:26,231 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:53:26,231 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20888622
2024-11-10 21:53:26,306 - DEBUG - [Pod ctest-pod-18921688] Cmd: wget http://10.102.244.209:80/ -O - -T 5 -t 1 , Output: ctest-pod-35331865
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:53:26,306 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd wget http://10.102.244.209:80/ -O - -T 5 -t 1 passed
2024-11-10 21:53:26,306 - DEBUG - [Pod Pod ctest-pod-18921688] Cmd output: ctest-pod-35331865
Connecting to 10.102.244.209:80 (10.102.244.209:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 21:53:26,306 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35331865': 1, 'ctest-pod-20888622': 2}
2024-11-10 21:53:28,379 - DEBUG - [Pod ctest-pod-92921544] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.681 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.138 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.295 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.138/0.371/0.681 ms
2024-11-10 21:53:28,379 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-92921544 with expectation True passed
2024-11-10 21:53:30,485 - DEBUG - [Pod ctest-pod-71377017] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.235 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.154 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.194 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.154/0.527/1.235 ms
2024-11-10 21:53:30,485 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-71377017 with expectation True passed
2024-11-10 21:53:32,613 - DEBUG - [Pod ctest-pod-18921688] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.998 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.152 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.407/0.998 ms
2024-11-10 21:53:32,614 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18921688 with expectation True passed
2024-11-10 21:53:32,715 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 21:53:32,715 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-11-10 21:53:32,715 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 21:53:32,716 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92921544 passed
2024-11-10 21:53:32,781 - DEBUG - [Pod ctest-pod-92921544] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 21:53:32,782 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-11-10 21:53:32,782 - DEBUG - [Pod Pod ctest-pod-92921544] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 21:53:32,782 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92921544 passed
2024-11-10 21:53:37,847 - DEBUG - [Pod ctest-pod-71377017] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 21:53:37,847 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 21:53:37,847 - DEBUG - [Pod Pod ctest-pod-71377017] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 21:53:37,847 - INFO - wget check of of http://10.47.255.250 from ctest-pod-71377017 passed
2024-11-10 21:53:37,911 - DEBUG - [Pod ctest-pod-82900706] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 21:53:37,911 - DEBUG - [Pod Pod ctest-pod-82900706] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-11-10 21:53:37,911 - DEBUG - [Pod Pod ctest-pod-82900706] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 21:53:37,911 - INFO - wget check of of http://10.47.255.251 from ctest-pod-82900706 passed
2024-11-10 21:53:37,912 - INFO - Deleting Network Policy : ingress-on-service
2024-11-10 21:53:37,912 - INFO - Deleting service : ctest-nginx-svc-18136509
2024-11-10 21:53:38,239 - DEBUG - No XMPP flaps were noticed during the test
2024-11-10 21:53:38,239 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09]
2024-11-10 21:53:38,239 - INFO - --------------------------------------------------------------------------------
2024-11-10 21:53:38,247 - INFO - Deleting pod ctest-new-default-76902101:ctest-pod-35331865
2024-11-10 21:53:38,247 - INFO - Deleting pod ctest-new-default-76902101:ctest-pod-20888622
2024-11-10 21:53:38,248 - INFO - Deleting pod ctest-non-default-52897091:ctest-pod-04667387
2024-11-10 21:53:38,248 - INFO - Deleting pod ctest-non-default-52897091:ctest-pod-68048326
2024-11-10 21:53:38,248 - INFO - Deleting pod ctest-new-default-76902101:ctest-pod-71377017
2024-11-10 21:53:38,249 - INFO - Deleting pod ctest-new-default-76902101:ctest-pod-92921544
2024-11-10 21:53:38,249 - INFO - Deleting pod ctest-non-default-52897091:ctest-pod-18921688
2024-11-10 21:53:38,255 - INFO - Deleting pod ctest-non-default-52897091:ctest-pod-82900706
2024-11-10 21:53:38,442 - WARNING - Pod uuid d6be87bf-e4a2-4ce1-930e-f20c76f601f9 is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:38,466 - WARNING - Pod uuid fc857a67-f605-4e47-a7ab-4d2ec38981dc is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:38,467 - WARNING - Pod uuid f85ded9d-2784-4106-8a4c-62624fdbd409 is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:38,468 - WARNING - Pod uuid 946b48f4-9a10-420f-a2bf-ff152bb2909c is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:38,472 - WARNING - Pod uuid 74213849-91be-4aa1-b5d1-23feac0526df is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:38,475 - WARNING - Pod uuid b6c31725-6407-4f16-88bd-e88368d4fecb is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:38,478 - WARNING - Pod uuid 55093aec-7f99-400f-b686-6f873428a888 is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:38,480 - WARNING - Pod uuid dfeb9225-94a5-4666-8510-9318a813cf65 is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:43,453 - DEBUG - Pod d6be87bf-e4a2-4ce1-930e-f20c76f601f9 is not in agent 10.0.0.43 VM list
2024-11-10 21:53:43,461 - DEBUG - VMI c1d7d1b0-9fad-11ef-b47f-fa163e7a64e6 is removed from agent 10.0.0.43
2024-11-10 21:53:43,461 - INFO - Verified that pod ctest-pod-35331865 is removed in agent
2024-11-10 21:53:43,484 - WARNING - Pod uuid fc857a67-f605-4e47-a7ab-4d2ec38981dc is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:43,487 - WARNING - Pod uuid 946b48f4-9a10-420f-a2bf-ff152bb2909c is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:43,487 - WARNING - Pod uuid f85ded9d-2784-4106-8a4c-62624fdbd409 is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:43,502 - WARNING - Pod uuid b6c31725-6407-4f16-88bd-e88368d4fecb is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:43,502 - DEBUG - Pod 74213849-91be-4aa1-b5d1-23feac0526df is not in agent 10.0.0.43 VM list
2024-11-10 21:53:43,506 - DEBUG - Pod dfeb9225-94a5-4666-8510-9318a813cf65 is not in agent 10.0.0.43 VM list
2024-11-10 21:53:43,508 - DEBUG - Pod 55093aec-7f99-400f-b686-6f873428a888 is not in agent 10.0.0.43 VM list
2024-11-10 21:53:43,524 - DEBUG - VMI c3e83580-9fad-11ef-b47f-fa163e7a64e6 is removed from agent 10.0.0.43
2024-11-10 21:53:43,524 - INFO - Verified that pod ctest-pod-68048326 is removed in agent
2024-11-10 21:53:43,526 - DEBUG - VMI c34f1ea4-9fad-11ef-b47f-fa163e7a64e6 is removed from agent 10.0.0.43
2024-11-10 21:53:43,526 - INFO - Verified that pod ctest-pod-04667387 is removed in agent
2024-11-10 21:53:43,526 - DEBUG - VMI c2744630-9fad-11ef-b47f-fa163e7a64e6 is removed from agent 10.0.0.43
2024-11-10 21:53:43,526 - INFO - Verified that pod ctest-pod-20888622 is removed in agent
2024-11-10 21:53:48,518 - WARNING - Pod uuid 946b48f4-9a10-420f-a2bf-ff152bb2909c is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:48,528 - WARNING - Pod uuid f85ded9d-2784-4106-8a4c-62624fdbd409 is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:48,528 - WARNING - Pod uuid fc857a67-f605-4e47-a7ab-4d2ec38981dc is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:48,529 - WARNING - Pod uuid b6c31725-6407-4f16-88bd-e88368d4fecb is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:53,534 - WARNING - Pod uuid 946b48f4-9a10-420f-a2bf-ff152bb2909c is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:53,565 - WARNING - Pod uuid fc857a67-f605-4e47-a7ab-4d2ec38981dc is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:53,567 - WARNING - Pod uuid b6c31725-6407-4f16-88bd-e88368d4fecb is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:53,567 - WARNING - Pod uuid f85ded9d-2784-4106-8a4c-62624fdbd409 is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:58,558 - WARNING - Pod uuid 946b48f4-9a10-420f-a2bf-ff152bb2909c is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:58,599 - WARNING - Pod uuid fc857a67-f605-4e47-a7ab-4d2ec38981dc is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:58,603 - WARNING - Pod uuid f85ded9d-2784-4106-8a4c-62624fdbd409 is still seen in agent 10.0.0.43 VM list
2024-11-10 21:53:58,603 - WARNING - Pod uuid b6c31725-6407-4f16-88bd-e88368d4fecb is still seen in agent 10.0.0.43 VM list
2024-11-10 21:54:03,576 - WARNING - Pod uuid 946b48f4-9a10-420f-a2bf-ff152bb2909c is still seen in agent 10.0.0.43 VM list
2024-11-10 21:54:03,638 - WARNING - Pod uuid fc857a67-f605-4e47-a7ab-4d2ec38981dc is still seen in agent 10.0.0.43 VM list
2024-11-10 21:54:03,640 - WARNING - Pod uuid b6c31725-6407-4f16-88bd-e88368d4fecb is still seen in agent 10.0.0.43 VM list
2024-11-10 21:54:03,640 - WARNING - Pod uuid f85ded9d-2784-4106-8a4c-62624fdbd409 is still seen in agent 10.0.0.43 VM list
2024-11-10 21:54:08,586 - WARNING - Pod uuid 946b48f4-9a10-420f-a2bf-ff152bb2909c is still seen in agent 10.0.0.43 VM list
2024-11-10 21:54:08,655 - WARNING - Pod uuid fc857a67-f605-4e47-a7ab-4d2ec38981dc is still seen in agent 10.0.0.43 VM list
2024-11-10 21:54:08,656 - WARNING - Pod uuid b6c31725-6407-4f16-88bd-e88368d4fecb is still seen in agent 10.0.0.43 VM list
2024-11-10 21:54:08,656 - WARNING - Pod uuid f85ded9d-2784-4106-8a4c-62624fdbd409 is still seen in agent 10.0.0.43 VM list
2024-11-10 21:54:13,602 - DEBUG - Pod 946b48f4-9a10-420f-a2bf-ff152bb2909c is not in agent 10.0.0.43 VM list
2024-11-10 21:54:13,617 - DEBUG - VMI c4a1aace-9fad-11ef-b47f-fa163e7a64e6 is removed from agent 10.0.0.43
2024-11-10 21:54:13,617 - INFO - Verified that pod ctest-pod-71377017 is removed in agent
2024-11-10 21:54:13,688 - DEBUG - Pod fc857a67-f605-4e47-a7ab-4d2ec38981dc is not in agent 10.0.0.43 VM list
2024-11-10 21:54:13,697 - DEBUG - Pod f85ded9d-2784-4106-8a4c-62624fdbd409 is not in agent 10.0.0.43 VM list
2024-11-10 21:54:13,699 - DEBUG - Pod b6c31725-6407-4f16-88bd-e88368d4fecb is not in agent 10.0.0.43 VM list
2024-11-10 21:54:13,727 - DEBUG - VMI c5ee461c-9fad-11ef-b47f-fa163e7a64e6 is removed from agent 10.0.0.43
2024-11-10 21:54:13,727 - INFO - Verified that pod ctest-pod-18921688 is removed in agent
2024-11-10 21:54:13,729 - DEBUG - VMI c53ccffe-9fad-11ef-b47f-fa163e7a64e6 is removed from agent 10.0.0.43
2024-11-10 21:54:13,729 - INFO - Verified that pod ctest-pod-92921544 is removed in agent
2024-11-10 21:54:13,729 - DEBUG - VMI c6850aac-9fad-11ef-b47f-fa163e7a64e6 is removed from agent 10.0.0.43
2024-11-10 21:54:13,729 - INFO - Verified that pod ctest-pod-82900706 is removed in agent
2024-11-10 21:54:13,730 - INFO - Deleting namespace ctest-non-default-52897091
2024-11-10 21:54:13,745 - DEBUG - Namespace ctest-non-default-52897091 still in k8s
2024-11-10 21:54:15,751 - DEBUG - Namespace ctest-non-default-52897091 still in k8s
2024-11-10 21:54:17,756 - DEBUG - Namespace ctest-non-default-52897091 still in k8s
2024-11-10 21:54:19,761 - DEBUG - Namespace ctest-non-default-52897091 is not in k8s
2024-11-10 21:54:19,762 - DEBUG - No need to check project deletion in contrail-api
2024-11-10 21:54:19,762 - INFO - Deleting namespace ctest-new-default-76902101
2024-11-10 21:54:19,775 - DEBUG - Namespace ctest-new-default-76902101 still in k8s
2024-11-10 21:54:21,780 - DEBUG - Namespace ctest-new-default-76902101 still in k8s
2024-11-10 21:54:23,787 - DEBUG - Namespace ctest-new-default-76902101 still in k8s
2024-11-10 21:54:25,790 - DEBUG - Namespace ctest-new-default-76902101 is not in k8s
2024-11-10 21:54:25,790 - DEBUG - No need to check project deletion in contrail-api