2024-10-24 02:29:33,943 - INFO - Using existing project ['default-domain', 'k8s-default'](13a482c9-08c1-4160-9cd9-e33278309c80)
2024-10-24 02:29:33,961 - DEBUG - Namespace ctest-new-default-95770398 not present
2024-10-24 02:29:33,976 - INFO - Created namespace ctest-new-default-95770398
2024-10-24 02:29:36,982 - DEBUG - Namespace ctest-non-default-70768158 not present
2024-10-24 02:29:36,994 - INFO - Created namespace ctest-non-default-70768158
2024-10-24 02:29:40,018 - DEBUG - Pod ctest-pod-98894380 not present
2024-10-24 02:29:40,018 - INFO - Creating Pod ctest-pod-98894380
2024-10-24 02:29:40,054 - DEBUG - Pod : ctest-pod-98894380 UUID is e31b4bb0-b9a7-4617-8c8d-5c100a38a036
2024-10-24 02:29:40,076 - DEBUG - Pod ctest-pod-03318013 not present
2024-10-24 02:29:40,076 - INFO - Creating Pod ctest-pod-03318013
2024-10-24 02:29:40,096 - DEBUG - Pod : ctest-pod-03318013 UUID is d8a59447-62e6-481d-8707-4efdf701f7ca
2024-10-24 02:29:40,105 - DEBUG - Pod ctest-pod-56845739 not present
2024-10-24 02:29:40,105 - INFO - Creating Pod ctest-pod-56845739
2024-10-24 02:29:40,149 - DEBUG - Pod : ctest-pod-56845739 UUID is 63707bf2-18bb-43a0-9f09-4be119f7044b
2024-10-24 02:29:40,157 - DEBUG - Pod ctest-pod-84290345 not present
2024-10-24 02:29:40,157 - INFO - Creating Pod ctest-pod-84290345
2024-10-24 02:29:40,208 - DEBUG - Pod : ctest-pod-84290345 UUID is 283eb6cb-4c62-484c-bc8d-facefa2aa7a8
2024-10-24 02:29:40,214 - DEBUG - Pod ctest-pod-49324338 not present
2024-10-24 02:29:40,215 - INFO - Creating Pod ctest-pod-49324338
2024-10-24 02:29:40,243 - DEBUG - Pod : ctest-pod-49324338 UUID is 3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd
2024-10-24 02:29:40,246 - DEBUG - Pod ctest-pod-46672330 not present
2024-10-24 02:29:40,246 - INFO - Creating Pod ctest-pod-46672330
2024-10-24 02:29:40,265 - DEBUG - Pod : ctest-pod-46672330 UUID is 270b96be-103b-4ad5-823e-8793395a07a3
2024-10-24 02:29:40,268 - DEBUG - Pod ctest-pod-35520231 not present
2024-10-24 02:29:40,268 - INFO - Creating Pod ctest-pod-35520231
2024-10-24 02:29:40,290 - DEBUG - Pod : ctest-pod-35520231 UUID is bdaa295e-131f-4f93-9172-699bb5e2cd28
2024-10-24 02:29:40,292 - DEBUG - Pod ctest-pod-59761918 not present
2024-10-24 02:29:40,293 - INFO - Creating Pod ctest-pod-59761918
2024-10-24 02:29:40,340 - DEBUG - Pod : ctest-pod-59761918 UUID is 9f52d719-88f0-41d7-9f45-168eeb191024
2024-10-24 02:29:40,592 - INFO - Project default-domain:k8s-ctest-new-default-95770398 for Namespace ctest-new-default-95770398 is seen in contrail-api
2024-10-24 02:29:40,592 - DEBUG - Project uuid in Contrail is 08eedc31-98ce-4e68-9460-13c2ac1776cf
2024-10-24 02:29:40,794 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NamespaceDatabaseList?namespace_uuid=20513fd0-cbf7-4b54-ab4b-033ea0480ec4
2024-10-24 02:29:40,800 - INFO - Namespace ctest-new-default-95770398 with uuid 20513fd0-cbf7-4b54-ab4b-033ea0480ec4 found in kube manager
2024-10-24 02:29:40,801 - INFO - Namespace ctest-new-default-95770398 verification passed
2024-10-24 02:29:41,080 - INFO - Project default-domain:k8s-ctest-non-default-70768158 for Namespace ctest-non-default-70768158 is seen in contrail-api
2024-10-24 02:29:41,080 - DEBUG - Project uuid in Contrail is e74c4afa-88e6-4d11-962f-2c38d593cc3d
2024-10-24 02:29:41,080 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NamespaceDatabaseList?namespace_uuid=e787d398-0a72-44e2-9d09-edb4f244f982
2024-10-24 02:29:41,087 - INFO - Namespace ctest-non-default-70768158 with uuid e787d398-0a72-44e2-9d09-edb4f244f982 found in kube manager
2024-10-24 02:29:41,087 - INFO - Namespace ctest-non-default-70768158 verification passed
2024-10-24 02:29:41,095 - DEBUG - Pod ctest-pod-98894380 not in running state.Currently in Pending
2024-10-24 02:29:46,103 - DEBUG - Pod ctest-pod-98894380 not in running state.Currently in Pending
2024-10-24 02:29:51,110 - INFO - Pod ctest-pod-98894380 is in running state.Got IP 10.47.255.251
2024-10-24 02:29:51,131 - DEBUG - Pod ctest-pod-98894380 has vmi d34d39dc-91af-11ef-8e4c-fa163ecb9fc5
2024-10-24 02:29:51,132 - INFO - Verified pod ctest-pod-98894380 in contrail-api
2024-10-24 02:29:51,146 - DEBUG - VMI d34d39dc-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23
2024-10-24 02:29:51,146 - INFO - Verified Pod ctest-pod-98894380 in agent 10.0.0.23
2024-10-24 02:29:51,146 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=e31b4bb0-b9a7-4617-8c8d-5c100a38a036
2024-10-24 02:29:51,152 - INFO - Pod ctest-pod-98894380 with uuid e31b4bb0-b9a7-4617-8c8d-5c100a38a036 found in kube manager
2024-10-24 02:29:51,152 - INFO - Pod ctest-pod-98894380 verification passed
2024-10-24 02:29:51,158 - INFO - Pod ctest-pod-03318013 is in running state.Got IP 10.47.255.250
2024-10-24 02:29:51,220 - DEBUG - Pod ctest-pod-03318013 has vmi d3ec1f0c-91af-11ef-8e4c-fa163ecb9fc5
2024-10-24 02:29:51,220 - INFO - Verified pod ctest-pod-03318013 in contrail-api
2024-10-24 02:29:51,233 - DEBUG - VMI d3ec1f0c-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23
2024-10-24 02:29:51,233 - INFO - Verified Pod ctest-pod-03318013 in agent 10.0.0.23
2024-10-24 02:29:51,233 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=d8a59447-62e6-481d-8707-4efdf701f7ca
2024-10-24 02:29:51,239 - INFO - Pod ctest-pod-03318013 with uuid d8a59447-62e6-481d-8707-4efdf701f7ca found in kube manager
2024-10-24 02:29:51,239 - INFO - Pod ctest-pod-03318013 verification passed
2024-10-24 02:29:51,245 - DEBUG - Pod ctest-pod-56845739 not in running state.Currently in Pending
2024-10-24 02:29:56,252 - INFO - Pod ctest-pod-56845739 is in running state.Got IP 10.47.255.249
2024-10-24 02:29:56,274 - DEBUG - Pod ctest-pod-56845739 has vmi d4ae9e9c-91af-11ef-8e4c-fa163ecb9fc5
2024-10-24 02:29:56,274 - INFO - Verified pod ctest-pod-56845739 in contrail-api
2024-10-24 02:29:56,290 - DEBUG - VMI d4ae9e9c-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23
2024-10-24 02:29:56,290 - INFO - Verified Pod ctest-pod-56845739 in agent 10.0.0.23
2024-10-24 02:29:56,290 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=63707bf2-18bb-43a0-9f09-4be119f7044b
2024-10-24 02:29:56,296 - INFO - Pod ctest-pod-56845739 with uuid 63707bf2-18bb-43a0-9f09-4be119f7044b found in kube manager
2024-10-24 02:29:56,297 - INFO - Pod ctest-pod-56845739 verification passed
2024-10-24 02:29:56,304 - INFO - Pod ctest-pod-84290345 is in running state.Got IP 10.47.255.248
2024-10-24 02:29:56,372 - DEBUG - Pod ctest-pod-84290345 has vmi d538719e-91af-11ef-8e4c-fa163ecb9fc5
2024-10-24 02:29:56,372 - INFO - Verified pod ctest-pod-84290345 in contrail-api
2024-10-24 02:29:56,451 - DEBUG - VMI d538719e-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23
2024-10-24 02:29:56,452 - INFO - Verified Pod ctest-pod-84290345 in agent 10.0.0.23
2024-10-24 02:29:56,452 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=283eb6cb-4c62-484c-bc8d-facefa2aa7a8
2024-10-24 02:29:56,458 - INFO - Pod ctest-pod-84290345 with uuid 283eb6cb-4c62-484c-bc8d-facefa2aa7a8 found in kube manager
2024-10-24 02:29:56,459 - INFO - Pod ctest-pod-84290345 verification passed
2024-10-24 02:29:56,465 - DEBUG - Pod ctest-pod-49324338 not in running state.Currently in Pending
2024-10-24 02:30:01,475 - INFO - Pod ctest-pod-49324338 is in running state.Got IP 10.47.255.247
2024-10-24 02:30:01,496 - DEBUG - Pod ctest-pod-49324338 has vmi d5dc7ba4-91af-11ef-8e4c-fa163ecb9fc5
2024-10-24 02:30:01,496 - INFO - Verified pod ctest-pod-49324338 in contrail-api
2024-10-24 02:30:01,513 - DEBUG - VMI d5dc7ba4-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23
2024-10-24 02:30:01,513 - INFO - Verified Pod ctest-pod-49324338 in agent 10.0.0.23
2024-10-24 02:30:01,513 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd
2024-10-24 02:30:01,519 - INFO - Pod ctest-pod-49324338 with uuid 3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd found in kube manager
2024-10-24 02:30:01,520 - INFO - Pod ctest-pod-49324338 verification passed
2024-10-24 02:30:01,526 - INFO - Pod ctest-pod-35520231 is in running state.Got IP 10.47.255.245
2024-10-24 02:30:01,596 - DEBUG - Pod ctest-pod-35520231 has vmi d700f0b4-91af-11ef-8e4c-fa163ecb9fc5
2024-10-24 02:30:01,596 - INFO - Verified pod ctest-pod-35520231 in contrail-api
2024-10-24 02:30:01,618 - DEBUG - VMI d700f0b4-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23
2024-10-24 02:30:01,618 - INFO - Verified Pod ctest-pod-35520231 in agent 10.0.0.23
2024-10-24 02:30:01,619 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=bdaa295e-131f-4f93-9172-699bb5e2cd28
2024-10-24 02:30:01,627 - INFO - Pod ctest-pod-35520231 with uuid bdaa295e-131f-4f93-9172-699bb5e2cd28 found in kube manager
2024-10-24 02:30:01,627 - INFO - Pod ctest-pod-35520231 verification passed
2024-10-24 02:30:01,635 - INFO - Pod ctest-pod-46672330 is in running state.Got IP 10.47.255.246
2024-10-24 02:30:01,657 - DEBUG - Pod ctest-pod-46672330 has vmi d669e3f4-91af-11ef-8e4c-fa163ecb9fc5
2024-10-24 02:30:01,657 - INFO - Verified pod ctest-pod-46672330 in contrail-api
2024-10-24 02:30:01,675 - DEBUG - VMI d669e3f4-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23
2024-10-24 02:30:01,675 - INFO - Verified Pod ctest-pod-46672330 in agent 10.0.0.23
2024-10-24 02:30:01,676 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=270b96be-103b-4ad5-823e-8793395a07a3
2024-10-24 02:30:01,683 - INFO - Pod ctest-pod-46672330 with uuid 270b96be-103b-4ad5-823e-8793395a07a3 found in kube manager
2024-10-24 02:30:01,683 - INFO - Pod ctest-pod-46672330 verification passed
2024-10-24 02:30:01,689 - INFO - Pod ctest-pod-59761918 is in running state.Got IP 10.47.255.244
2024-10-24 02:30:01,756 - DEBUG - Pod ctest-pod-59761918 has vmi d78e58c8-91af-11ef-8e4c-fa163ecb9fc5
2024-10-24 02:30:01,756 - INFO - Verified pod ctest-pod-59761918 in contrail-api
2024-10-24 02:30:01,773 - DEBUG - VMI d78e58c8-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23
2024-10-24 02:30:01,773 - INFO - Verified Pod ctest-pod-59761918 in agent 10.0.0.23
2024-10-24 02:30:01,773 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=9f52d719-88f0-41d7-9f45-168eeb191024
2024-10-24 02:30:01,778 - INFO - Pod ctest-pod-59761918 with uuid 9f52d719-88f0-41d7-9f45-168eeb191024 found in kube manager
2024-10-24 02:30:01,778 - INFO - Pod ctest-pod-59761918 verification passed
2024-10-24 02:30:01,779 - INFO - ================================================================================
2024-10-24 02:30:01,779 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-10-24 02:30:01,779 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-10-24 02:30:01,997 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.45': '0'}} with
2024-10-24 02:30:01,997 - INFO - Initial checks done. Running the testcase now
2024-10-24 02:30:01,998 - INFO -
2024-10-24 02:30:02,060 - DEBUG - [Pod ctest-pod-98894380] Cmd: echo ctest-pod-98894380 > /usr/share/nginx/html/index.html, Output:
2024-10-24 02:30:02,127 - DEBUG - [Pod ctest-pod-03318013] Cmd: echo ctest-pod-03318013 > /usr/share/nginx/html/index.html, Output:
2024-10-24 02:30:02,217 - DEBUG - [Pod ctest-pod-56845739] Cmd: echo ctest-pod-56845739 > /usr/share/nginx/html/index.html, Output:
2024-10-24 02:30:02,293 - DEBUG - [Pod ctest-pod-84290345] Cmd: echo ctest-pod-84290345 > /usr/share/nginx/html/index.html, Output:
2024-10-24 02:30:02,297 - DEBUG - Service ctest-nginx-svc-49564064 not present
2024-10-24 02:30:02,298 - INFO - Creating service ctest-nginx-svc-49564064
2024-10-24 02:30:02,321 - INFO - Created Service ctest-nginx-svc-49564064
2024-10-24 02:30:02,327 - WARNING - Service UUID a90c98bf-5189-40e3-8ecd-fa09e809d4b4 not yet found in contrail-api
2024-10-24 02:30:03,337 - INFO - Validated that Service ctest-nginx-svc-49564064 is seen in contrail-api
2024-10-24 02:30:03,337 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_LoadbalancerDatabaseList?x=a90c98bf-5189-40e3-8ecd-fa09e809d4b4
2024-10-24 02:30:03,343 - INFO - Service ctest-nginx-svc-49564064 with uuid a90c98bf-5189-40e3-8ecd-fa09e809d4b4 found in kube manager
2024-10-24 02:30:03,343 - INFO - Service ctest-nginx-svc-49564064 verification passed
2024-10-24 02:30:04,435 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03318013
2024-10-24 02:30:04,435 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:30:04,435 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03318013
2024-10-24 02:30:04,500 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: ctest-pod-98894380
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:04,500 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:30:04,500 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: ctest-pod-98894380
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:04,500 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98894380': 1, 'ctest-pod-03318013': 1}
2024-10-24 02:30:04,571 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: ctest-pod-98894380
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:04,571 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:30:04,571 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: ctest-pod-98894380
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:04,661 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: ctest-pod-03318013
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:04,661 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:30:04,661 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: ctest-pod-03318013
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:04,661 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98894380': 1, 'ctest-pod-03318013': 1}
2024-10-24 02:30:04,665 - DEBUG - Network policy ingress-on-service not present
2024-10-24 02:30:04,667 - INFO - Creating Network Policy ingress-on-service
2024-10-24 02:30:04,695 - INFO - Network policy found in k8s
2024-10-24 02:30:04,695 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1e1fbdf4-ce5b-4a8c-b42a-790c1b67d80e
2024-10-24 02:30:04,712 - INFO - Network Policy ingress-on-service with uuid 1e1fbdf4-ce5b-4a8c-b42a-790c1b67d80e found in kube manager
2024-10-24 02:30:04,765 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-10-24 02:30:04,766 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-10-24 02:30:04,766 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1e1fbdf4-ce5b-4a8c-b42a-790c1b67d80e
2024-10-24 02:30:04,810 - WARNING - Network policy with name ingress-on-service not found in agent
2024-10-24 02:30:06,812 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1e1fbdf4-ce5b-4a8c-b42a-790c1b67d80e
2024-10-24 02:30:06,844 - INFO - Network policy with name ingress-on-service found in agent
2024-10-24 02:30:06,845 - INFO - Network Policy ingress-on-service verification passed
2024-10-24 02:30:11,920 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:11,920 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:11,920 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:16,984 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:16,984 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:16,984 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:22,039 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:22,039 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:22,039 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:27,106 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:27,107 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:27,107 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:32,180 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:32,181 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:32,181 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:37,234 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:37,234 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:37,234 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:42,305 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:42,305 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:42,306 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:47,366 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:47,366 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:47,366 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:52,422 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:52,422 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:52,422 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:57,474 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:57,474 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:57,474 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:30:57,474 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-98894380': 0, 'ctest-pod-03318013': 0}
2024-10-24 02:30:57,534 - DEBUG - [Pod ctest-pod-46672330] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: ctest-pod-03318013
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:57,534 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:30:57,534 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd output: ctest-pod-03318013
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:57,606 - DEBUG - [Pod ctest-pod-46672330] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: ctest-pod-03318013
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:57,606 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:30:57,606 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd output: ctest-pod-03318013
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:57,679 - DEBUG - [Pod ctest-pod-46672330] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: ctest-pod-98894380
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:57,679 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:30:57,679 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd output: ctest-pod-98894380
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:30:57,679 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98894380': 1, 'ctest-pod-03318013': 2}
2024-10-24 02:31:02,746 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:02,746 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:02,746 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:07,803 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:07,803 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:07,803 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:12,858 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:12,858 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:12,858 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:17,923 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:17,923 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:17,923 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:22,982 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:22,982 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:22,982 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:28,042 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:28,042 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:28,042 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:33,099 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:33,099 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:33,099 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:38,167 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:38,167 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:38,167 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:43,226 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:43,226 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:43,226 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:48,290 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:48,291 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:48,291 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:31:48,291 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-98894380': 0, 'ctest-pod-03318013': 0}
2024-10-24 02:31:50,345 - DEBUG - [Pod ctest-pod-46672330] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.173 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.088 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.446/1.173 ms
2024-10-24 02:31:50,346 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-46672330 with expectation True passed
2024-10-24 02:31:52,407 - DEBUG - [Pod ctest-pod-49324338] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.780 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.147 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.337/0.780 ms
2024-10-24 02:31:52,407 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49324338 with expectation True passed
2024-10-24 02:31:54,459 - DEBUG - [Pod ctest-pod-35520231] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.791 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.315/0.791 ms
2024-10-24 02:31:54,459 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35520231 with expectation True passed
2024-10-24 02:31:54,526 - DEBUG - [Pod ctest-pod-46672330] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:31:54,527 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-24 02:31:54,527 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:31:54,527 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46672330 passed
2024-10-24 02:31:54,606 - DEBUG - [Pod ctest-pod-46672330] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:31:54,606 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-24 02:31:54,606 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:31:54,606 - INFO - wget check of of http://10.47.255.250 from ctest-pod-46672330 passed
2024-10-24 02:31:59,680 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-24 02:31:59,680 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-24 02:31:59,680 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-24 02:31:59,680 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49324338 passed
2024-10-24 02:32:04,742 - DEBUG - [Pod ctest-pod-59761918] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-24 02:32:04,742 - DEBUG - [Pod Pod ctest-pod-59761918] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-24 02:32:04,742 - DEBUG - [Pod Pod ctest-pod-59761918] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-24 02:32:04,742 - INFO - wget check of of http://10.47.255.251 from ctest-pod-59761918 passed
2024-10-24 02:32:04,752 - INFO - Updating Network Policy ingress-on-service
2024-10-24 02:32:09,820 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:09,820 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:09,820 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:14,883 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:14,883 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:14,883 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:19,936 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:19,937 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:19,937 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:24,996 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:24,996 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:24,996 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:30,071 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:30,071 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:30,071 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:35,130 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:35,130 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:35,130 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:40,193 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:40,193 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:40,193 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:45,247 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:45,247 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:45,247 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:50,314 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:50,314 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:50,314 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:55,370 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:55,370 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:55,370 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.109.234.71:80 (10.109.234.71:80)
wget: download timed out
2024-10-24 02:32:55,370 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-98894380': 0, 'ctest-pod-03318013': 0}
2024-10-24 02:32:55,430 - DEBUG - [Pod ctest-pod-46672330] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: ctest-pod-98894380
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:32:55,431 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:32:55,431 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd output: ctest-pod-98894380
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:32:55,487 - DEBUG - [Pod ctest-pod-46672330] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: ctest-pod-03318013
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:32:55,487 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:32:55,487 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd output: ctest-pod-03318013
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:32:55,487 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98894380': 1, 'ctest-pod-03318013': 1}
2024-10-24 02:32:55,540 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: ctest-pod-98894380
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:32:55,540 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:32:55,540 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: ctest-pod-98894380
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:32:55,595 - DEBUG - [Pod ctest-pod-35520231] Cmd: wget http://10.109.234.71:80/ -O - -T 5 -t 1 , Output: ctest-pod-03318013
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:32:55,595 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd wget http://10.109.234.71:80/ -O - -T 5 -t 1 passed
2024-10-24 02:32:55,595 - DEBUG - [Pod Pod ctest-pod-35520231] Cmd output: ctest-pod-03318013
Connecting to 10.109.234.71:80 (10.109.234.71:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:32:55,595 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98894380': 1, 'ctest-pod-03318013': 1}
2024-10-24 02:32:57,661 - DEBUG - [Pod ctest-pod-46672330] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.701 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.283/0.701 ms
2024-10-24 02:32:57,662 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-46672330 with expectation True passed
2024-10-24 02:32:59,715 - DEBUG - [Pod ctest-pod-49324338] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.949 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.374/0.949 ms
2024-10-24 02:32:59,715 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49324338 with expectation True passed
2024-10-24 02:33:01,779 - DEBUG - [Pod ctest-pod-35520231] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.294 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.150/0.294 ms
2024-10-24 02:33:01,779 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35520231 with expectation True passed
2024-10-24 02:33:01,850 - DEBUG - [Pod ctest-pod-46672330] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:33:01,851 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-24 02:33:01,851 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:33:01,851 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46672330 passed
2024-10-24 02:33:01,916 - DEBUG - [Pod ctest-pod-46672330] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:33:01,916 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-24 02:33:01,916 - DEBUG - [Pod Pod ctest-pod-46672330] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:33:01,916 - INFO - wget check of of http://10.47.255.250 from ctest-pod-46672330 passed
2024-10-24 02:33:06,982 - DEBUG - [Pod ctest-pod-49324338] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-24 02:33:06,982 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-24 02:33:06,982 - DEBUG - [Pod Pod ctest-pod-49324338] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-24 02:33:06,982 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49324338 passed
2024-10-24 02:33:07,042 - DEBUG - [Pod ctest-pod-59761918] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:33:07,043 - DEBUG - [Pod Pod ctest-pod-59761918] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-24 02:33:07,043 - DEBUG - [Pod Pod ctest-pod-59761918] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:33:07,043 - INFO - wget check of of http://10.47.255.251 from ctest-pod-59761918 passed
2024-10-24 02:33:07,043 - INFO - Deleting Network Policy : ingress-on-service
2024-10-24 02:33:07,043 - INFO - Deleting service : ctest-nginx-svc-49564064
2024-10-24 02:33:07,266 - DEBUG - No XMPP flaps were noticed during the test
2024-10-24 02:33:07,266 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-10-24 02:33:07,266 - INFO - --------------------------------------------------------------------------------
2024-10-24 02:33:07,273 - INFO - Deleting pod ctest-new-default-95770398:ctest-pod-98894380
2024-10-24 02:33:07,274 - INFO - Deleting pod ctest-new-default-95770398:ctest-pod-03318013
2024-10-24 02:33:07,274 - INFO - Deleting pod ctest-non-default-70768158:ctest-pod-56845739
2024-10-24 02:33:07,274 - INFO - Deleting pod ctest-non-default-70768158:ctest-pod-84290345
2024-10-24 02:33:07,275 - INFO - Deleting pod ctest-new-default-95770398:ctest-pod-49324338
2024-10-24 02:33:07,275 - INFO - Deleting pod ctest-new-default-95770398:ctest-pod-46672330
2024-10-24 02:33:07,275 - INFO - Deleting pod ctest-non-default-70768158:ctest-pod-35520231
2024-10-24 02:33:07,276 - INFO - Deleting pod ctest-non-default-70768158:ctest-pod-59761918
2024-10-24 02:33:07,302 - WARNING - Pod uuid e31b4bb0-b9a7-4617-8c8d-5c100a38a036 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:07,384 - WARNING - Pod uuid 3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:07,390 - WARNING - Pod uuid d8a59447-62e6-481d-8707-4efdf701f7ca is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:07,406 - WARNING - Pod uuid 9f52d719-88f0-41d7-9f45-168eeb191024 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:07,406 - WARNING - Pod uuid bdaa295e-131f-4f93-9172-699bb5e2cd28 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:07,407 - WARNING - Pod uuid 283eb6cb-4c62-484c-bc8d-facefa2aa7a8 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:07,407 - WARNING - Pod uuid 63707bf2-18bb-43a0-9f09-4be119f7044b is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:07,487 - WARNING - Pod uuid 270b96be-103b-4ad5-823e-8793395a07a3 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:12,310 - WARNING - Pod uuid e31b4bb0-b9a7-4617-8c8d-5c100a38a036 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:12,395 - WARNING - Pod uuid 3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:12,400 - WARNING - Pod uuid d8a59447-62e6-481d-8707-4efdf701f7ca is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:12,424 - WARNING - Pod uuid bdaa295e-131f-4f93-9172-699bb5e2cd28 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:12,427 - DEBUG - Pod 63707bf2-18bb-43a0-9f09-4be119f7044b is not in agent 10.0.0.23 VM list
2024-10-24 02:33:12,430 - DEBUG - Pod 283eb6cb-4c62-484c-bc8d-facefa2aa7a8 is not in agent 10.0.0.23 VM list
2024-10-24 02:33:12,432 - WARNING - Pod uuid 9f52d719-88f0-41d7-9f45-168eeb191024 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:12,442 - DEBUG - VMI d4ae9e9c-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23
2024-10-24 02:33:12,442 - INFO - Verified that pod ctest-pod-56845739 is removed in agent
2024-10-24 02:33:12,443 - DEBUG - VMI d538719e-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23
2024-10-24 02:33:12,443 - INFO - Verified that pod ctest-pod-84290345 is removed in agent
2024-10-24 02:33:12,498 - WARNING - Pod uuid 270b96be-103b-4ad5-823e-8793395a07a3 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:17,320 - WARNING - Pod uuid e31b4bb0-b9a7-4617-8c8d-5c100a38a036 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:17,403 - WARNING - Pod uuid 3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:17,409 - WARNING - Pod uuid d8a59447-62e6-481d-8707-4efdf701f7ca is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:17,433 - WARNING - Pod uuid bdaa295e-131f-4f93-9172-699bb5e2cd28 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:17,441 - WARNING - Pod uuid 9f52d719-88f0-41d7-9f45-168eeb191024 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:17,506 - WARNING - Pod uuid 270b96be-103b-4ad5-823e-8793395a07a3 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:22,329 - WARNING - Pod uuid e31b4bb0-b9a7-4617-8c8d-5c100a38a036 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:22,413 - WARNING - Pod uuid 3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:22,418 - WARNING - Pod uuid d8a59447-62e6-481d-8707-4efdf701f7ca is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:22,451 - WARNING - Pod uuid 9f52d719-88f0-41d7-9f45-168eeb191024 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:22,452 - WARNING - Pod uuid bdaa295e-131f-4f93-9172-699bb5e2cd28 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:22,515 - WARNING - Pod uuid 270b96be-103b-4ad5-823e-8793395a07a3 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:27,339 - WARNING - Pod uuid e31b4bb0-b9a7-4617-8c8d-5c100a38a036 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:27,425 - WARNING - Pod uuid d8a59447-62e6-481d-8707-4efdf701f7ca is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:27,426 - WARNING - Pod uuid 3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:27,464 - WARNING - Pod uuid bdaa295e-131f-4f93-9172-699bb5e2cd28 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:27,466 - WARNING - Pod uuid 9f52d719-88f0-41d7-9f45-168eeb191024 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:27,525 - WARNING - Pod uuid 270b96be-103b-4ad5-823e-8793395a07a3 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:32,350 - WARNING - Pod uuid e31b4bb0-b9a7-4617-8c8d-5c100a38a036 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:32,437 - WARNING - Pod uuid 3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:32,439 - WARNING - Pod uuid d8a59447-62e6-481d-8707-4efdf701f7ca is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:32,477 - WARNING - Pod uuid bdaa295e-131f-4f93-9172-699bb5e2cd28 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:32,478 - WARNING - Pod uuid 9f52d719-88f0-41d7-9f45-168eeb191024 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:32,534 - WARNING - Pod uuid 270b96be-103b-4ad5-823e-8793395a07a3 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:37,367 - WARNING - Pod uuid e31b4bb0-b9a7-4617-8c8d-5c100a38a036 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:37,451 - WARNING - Pod uuid d8a59447-62e6-481d-8707-4efdf701f7ca is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:37,451 - WARNING - Pod uuid 3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:37,502 - WARNING - Pod uuid 9f52d719-88f0-41d7-9f45-168eeb191024 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:37,503 - WARNING - Pod uuid bdaa295e-131f-4f93-9172-699bb5e2cd28 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:37,545 - WARNING - Pod uuid 270b96be-103b-4ad5-823e-8793395a07a3 is still seen in agent 10.0.0.23 VM list
2024-10-24 02:33:42,377 - DEBUG - Pod e31b4bb0-b9a7-4617-8c8d-5c100a38a036 is not in agent 10.0.0.23 VM list
2024-10-24 02:33:42,384 - DEBUG - VMI d34d39dc-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23
2024-10-24 02:33:42,384 - INFO - Verified that pod ctest-pod-98894380 is removed in agent
2024-10-24 02:33:42,463 - DEBUG - Pod d8a59447-62e6-481d-8707-4efdf701f7ca is not in agent 10.0.0.23 VM list
2024-10-24 02:33:42,475 - DEBUG - Pod 3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd is not in agent 10.0.0.23 VM list
2024-10-24 02:33:42,497 - DEBUG - VMI d5dc7ba4-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23
2024-10-24 02:33:42,497 - INFO - Verified that pod ctest-pod-49324338 is removed in agent
2024-10-24 02:33:42,498 - DEBUG - VMI d3ec1f0c-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23
2024-10-24 02:33:42,498 - INFO - Verified that pod ctest-pod-03318013 is removed in agent
2024-10-24 02:33:42,516 - DEBUG - Pod bdaa295e-131f-4f93-9172-699bb5e2cd28 is not in agent 10.0.0.23 VM list
2024-10-24 02:33:42,518 - DEBUG - Pod 9f52d719-88f0-41d7-9f45-168eeb191024 is not in agent 10.0.0.23 VM list
2024-10-24 02:33:42,529 - DEBUG - VMI d700f0b4-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23
2024-10-24 02:33:42,529 - INFO - Verified that pod ctest-pod-35520231 is removed in agent
2024-10-24 02:33:42,529 - DEBUG - VMI d78e58c8-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23
2024-10-24 02:33:42,529 - INFO - Verified that pod ctest-pod-59761918 is removed in agent
2024-10-24 02:33:42,555 - DEBUG - Pod 270b96be-103b-4ad5-823e-8793395a07a3 is not in agent 10.0.0.23 VM list
2024-10-24 02:33:42,563 - DEBUG - VMI d669e3f4-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23
2024-10-24 02:33:42,563 - INFO - Verified that pod ctest-pod-46672330 is removed in agent
2024-10-24 02:33:42,563 - INFO - Deleting namespace ctest-non-default-70768158
2024-10-24 02:33:42,581 - DEBUG - Namespace ctest-non-default-70768158 still in k8s
2024-10-24 02:33:44,590 - DEBUG - Namespace ctest-non-default-70768158 still in k8s
2024-10-24 02:33:46,594 - DEBUG - Namespace ctest-non-default-70768158 still in k8s
2024-10-24 02:33:48,601 - DEBUG - Namespace ctest-non-default-70768158 is not in k8s
2024-10-24 02:33:48,602 - DEBUG - No need to check project deletion in contrail-api
2024-10-24 02:33:48,602 - INFO - Deleting namespace ctest-new-default-95770398
2024-10-24 02:33:48,622 - DEBUG - Namespace ctest-new-default-95770398 still in k8s
2024-10-24 02:33:50,627 - DEBUG - Namespace ctest-new-default-95770398 still in k8s
2024-10-24 02:33:52,632 - DEBUG - Namespace ctest-new-default-95770398 still in k8s
2024-10-24 02:33:54,636 - DEBUG - Namespace ctest-new-default-95770398 is not in k8s
2024-10-24 02:33:54,636 - DEBUG - No need to check project deletion in contrail-api