2024-11-13 12:39:52,341 - INFO - Using existing project ['default-domain', 'k8s-default'](ecb96806-85f2-4f72-a0a8-0f3de76d2386)
2024-11-13 12:39:52,360 - DEBUG - Namespace ctest-new-default-71787371 not present
2024-11-13 12:39:52,368 - INFO - Created namespace ctest-new-default-71787371
2024-11-13 12:39:55,372 - DEBUG - Namespace ctest-non-default-99615177 not present
2024-11-13 12:39:55,384 - INFO - Created namespace ctest-non-default-99615177
2024-11-13 12:39:58,406 - DEBUG - Pod ctest-pod-62831488 not present
2024-11-13 12:39:58,407 - INFO - Creating Pod ctest-pod-62831488
2024-11-13 12:39:58,437 - DEBUG - Pod : ctest-pod-62831488 UUID is 1075662c-fc9c-49ec-a7de-b470f4810b16
2024-11-13 12:39:58,439 - DEBUG - Pod ctest-pod-04091860 not present
2024-11-13 12:39:58,440 - INFO - Creating Pod ctest-pod-04091860
2024-11-13 12:39:58,457 - DEBUG - Pod : ctest-pod-04091860 UUID is d985f6a9-7765-485f-83e8-fdd2c93af5ea
2024-11-13 12:39:58,460 - DEBUG - Pod ctest-pod-95194136 not present
2024-11-13 12:39:58,461 - INFO - Creating Pod ctest-pod-95194136
2024-11-13 12:39:58,490 - DEBUG - Pod : ctest-pod-95194136 UUID is bed8f0d0-4dcb-4dcd-bf2e-efcf12b8e014
2024-11-13 12:39:58,493 - DEBUG - Pod ctest-pod-15197728 not present
2024-11-13 12:39:58,493 - INFO - Creating Pod ctest-pod-15197728
2024-11-13 12:39:58,517 - DEBUG - Pod : ctest-pod-15197728 UUID is b087334e-005a-447a-bfd0-e634c284a629
2024-11-13 12:39:58,520 - DEBUG - Pod ctest-pod-28312880 not present
2024-11-13 12:39:58,520 - INFO - Creating Pod ctest-pod-28312880
2024-11-13 12:39:58,549 - DEBUG - Pod : ctest-pod-28312880 UUID is bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb
2024-11-13 12:39:58,552 - DEBUG - Pod ctest-pod-67432069 not present
2024-11-13 12:39:58,552 - INFO - Creating Pod ctest-pod-67432069
2024-11-13 12:39:58,583 - DEBUG - Pod : ctest-pod-67432069 UUID is 686cdc05-e0a9-4e90-b71f-0dffac0c1984
2024-11-13 12:39:58,591 - DEBUG - Pod ctest-pod-79281087 not present
2024-11-13 12:39:58,591 - INFO - Creating Pod ctest-pod-79281087
2024-11-13 12:39:58,612 - DEBUG - Pod : ctest-pod-79281087 UUID is 08db7c4d-ce20-44fb-82df-5191577bd58e
2024-11-13 12:39:58,617 - DEBUG - Pod ctest-pod-15896055 not present
2024-11-13 12:39:58,617 - INFO - Creating Pod ctest-pod-15896055
2024-11-13 12:39:58,637 - DEBUG - Pod : ctest-pod-15896055 UUID is c7f36722-b14e-4ba9-ba34-bc6655e16365
2024-11-13 12:39:58,888 - INFO - Project default-domain:k8s-ctest-new-default-71787371 for Namespace ctest-new-default-71787371 is seen in contrail-api
2024-11-13 12:39:58,888 - DEBUG - Project uuid in Contrail is b690275c-16fa-4d61-a811-0b39c3b3c8f4
2024-11-13 12:39:59,016 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NamespaceDatabaseList?namespace_uuid=dbf1a564-9568-4f88-95ae-be38d6dcf821
2024-11-13 12:39:59,030 - INFO - Namespace ctest-new-default-71787371 with uuid dbf1a564-9568-4f88-95ae-be38d6dcf821 found in kube manager
2024-11-13 12:39:59,030 - INFO - Namespace ctest-new-default-71787371 verification passed
2024-11-13 12:39:59,229 - INFO - Project default-domain:k8s-ctest-non-default-99615177 for Namespace ctest-non-default-99615177 is seen in contrail-api
2024-11-13 12:39:59,229 - DEBUG - Project uuid in Contrail is 2a0c3bcb-9444-4fd4-9bb6-50e7fd7f273b
2024-11-13 12:39:59,229 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NamespaceDatabaseList?namespace_uuid=fc84d03a-2031-4112-a491-02a6d963961d
2024-11-13 12:39:59,235 - INFO - Namespace ctest-non-default-99615177 with uuid fc84d03a-2031-4112-a491-02a6d963961d found in kube manager
2024-11-13 12:39:59,236 - INFO - Namespace ctest-non-default-99615177 verification passed
2024-11-13 12:39:59,242 - DEBUG - Pod ctest-pod-62831488 not in running state.Currently in Pending
2024-11-13 12:40:04,250 - DEBUG - Pod ctest-pod-62831488 not in running state.Currently in Pending
2024-11-13 12:40:09,257 - INFO - Pod ctest-pod-62831488 is in running state.Got IP 10.47.255.251
2024-11-13 12:40:09,277 - DEBUG - Pod ctest-pod-62831488 has vmi 65daee2c-a1bc-11ef-bc9e-fa163e5b8c8d
2024-11-13 12:40:09,277 - INFO - Verified pod ctest-pod-62831488 in contrail-api
2024-11-13 12:40:09,293 - DEBUG - VMI 65daee2c-a1bc-11ef-bc9e-fa163e5b8c8d is active in agent 10.0.0.34
2024-11-13 12:40:09,293 - INFO - Verified Pod ctest-pod-62831488 in agent 10.0.0.34
2024-11-13 12:40:09,293 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=1075662c-fc9c-49ec-a7de-b470f4810b16
2024-11-13 12:40:09,301 - INFO - Pod ctest-pod-62831488 with uuid 1075662c-fc9c-49ec-a7de-b470f4810b16 found in kube manager
2024-11-13 12:40:09,301 - INFO - Pod ctest-pod-62831488 verification passed
2024-11-13 12:40:09,307 - INFO - Pod ctest-pod-04091860 is in running state.Got IP 10.47.255.250
2024-11-13 12:40:09,377 - DEBUG - Pod ctest-pod-04091860 has vmi 6682897a-a1bc-11ef-bc9e-fa163e5b8c8d
2024-11-13 12:40:09,377 - INFO - Verified pod ctest-pod-04091860 in contrail-api
2024-11-13 12:40:09,392 - DEBUG - VMI 6682897a-a1bc-11ef-bc9e-fa163e5b8c8d is active in agent 10.0.0.34
2024-11-13 12:40:09,393 - INFO - Verified Pod ctest-pod-04091860 in agent 10.0.0.34
2024-11-13 12:40:09,393 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=d985f6a9-7765-485f-83e8-fdd2c93af5ea
2024-11-13 12:40:09,399 - INFO - Pod ctest-pod-04091860 with uuid d985f6a9-7765-485f-83e8-fdd2c93af5ea found in kube manager
2024-11-13 12:40:09,400 - INFO - Pod ctest-pod-04091860 verification passed
2024-11-13 12:40:09,406 - DEBUG - Pod ctest-pod-95194136 not in running state.Currently in Pending
2024-11-13 12:40:14,413 - INFO - Pod ctest-pod-95194136 is in running state.Got IP 10.47.255.249
2024-11-13 12:40:14,431 - DEBUG - Pod ctest-pod-95194136 has vmi 673e9c0a-a1bc-11ef-bc9e-fa163e5b8c8d
2024-11-13 12:40:14,431 - INFO - Verified pod ctest-pod-95194136 in contrail-api
2024-11-13 12:40:14,446 - DEBUG - VMI 673e9c0a-a1bc-11ef-bc9e-fa163e5b8c8d is active in agent 10.0.0.34
2024-11-13 12:40:14,446 - INFO - Verified Pod ctest-pod-95194136 in agent 10.0.0.34
2024-11-13 12:40:14,446 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=bed8f0d0-4dcb-4dcd-bf2e-efcf12b8e014
2024-11-13 12:40:14,451 - INFO - Pod ctest-pod-95194136 with uuid bed8f0d0-4dcb-4dcd-bf2e-efcf12b8e014 found in kube manager
2024-11-13 12:40:14,451 - INFO - Pod ctest-pod-95194136 verification passed
2024-11-13 12:40:14,457 - INFO - Pod ctest-pod-15197728 is in running state.Got IP 10.47.255.248
2024-11-13 12:40:14,521 - DEBUG - Pod ctest-pod-15197728 has vmi 67d1c46c-a1bc-11ef-bc9e-fa163e5b8c8d
2024-11-13 12:40:14,521 - INFO - Verified pod ctest-pod-15197728 in contrail-api
2024-11-13 12:40:14,537 - DEBUG - VMI 67d1c46c-a1bc-11ef-bc9e-fa163e5b8c8d is active in agent 10.0.0.34
2024-11-13 12:40:14,537 - INFO - Verified Pod ctest-pod-15197728 in agent 10.0.0.34
2024-11-13 12:40:14,537 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=b087334e-005a-447a-bfd0-e634c284a629
2024-11-13 12:40:14,542 - INFO - Pod ctest-pod-15197728 with uuid b087334e-005a-447a-bfd0-e634c284a629 found in kube manager
2024-11-13 12:40:14,542 - INFO - Pod ctest-pod-15197728 verification passed
2024-11-13 12:40:14,549 - INFO - Pod ctest-pod-28312880 is in running state.Got IP 10.47.255.247
2024-11-13 12:40:14,612 - DEBUG - Pod ctest-pod-28312880 has vmi 687ba25c-a1bc-11ef-bc9e-fa163e5b8c8d
2024-11-13 12:40:14,613 - INFO - Verified pod ctest-pod-28312880 in contrail-api
2024-11-13 12:40:14,632 - DEBUG - VMI 687ba25c-a1bc-11ef-bc9e-fa163e5b8c8d is active in agent 10.0.0.34
2024-11-13 12:40:14,633 - INFO - Verified Pod ctest-pod-28312880 in agent 10.0.0.34
2024-11-13 12:40:14,633 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb
2024-11-13 12:40:14,639 - INFO - Pod ctest-pod-28312880 with uuid bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb found in kube manager
2024-11-13 12:40:14,639 - INFO - Pod ctest-pod-28312880 verification passed
2024-11-13 12:40:14,647 - DEBUG - Pod ctest-pod-79281087 not in running state.Currently in Pending
2024-11-13 12:40:19,659 - INFO - Pod ctest-pod-79281087 is in running state.Got IP 10.47.255.245
2024-11-13 12:40:19,850 - DEBUG - Pod ctest-pod-79281087 has vmi 698ed16e-a1bc-11ef-bc9e-fa163e5b8c8d
2024-11-13 12:40:19,850 - INFO - Verified pod ctest-pod-79281087 in contrail-api
2024-11-13 12:40:19,868 - DEBUG - VMI 698ed16e-a1bc-11ef-bc9e-fa163e5b8c8d is active in agent 10.0.0.34
2024-11-13 12:40:19,868 - INFO - Verified Pod ctest-pod-79281087 in agent 10.0.0.34
2024-11-13 12:40:19,868 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=08db7c4d-ce20-44fb-82df-5191577bd58e
2024-11-13 12:40:19,874 - INFO - Pod ctest-pod-79281087 with uuid 08db7c4d-ce20-44fb-82df-5191577bd58e found in kube manager
2024-11-13 12:40:19,875 - INFO - Pod ctest-pod-79281087 verification passed
2024-11-13 12:40:19,882 - INFO - Pod ctest-pod-67432069 is in running state.Got IP 10.47.255.246
2024-11-13 12:40:19,957 - DEBUG - Pod ctest-pod-67432069 has vmi 6906d62e-a1bc-11ef-bc9e-fa163e5b8c8d
2024-11-13 12:40:19,957 - INFO - Verified pod ctest-pod-67432069 in contrail-api
2024-11-13 12:40:19,981 - DEBUG - VMI 6906d62e-a1bc-11ef-bc9e-fa163e5b8c8d is active in agent 10.0.0.34
2024-11-13 12:40:19,981 - INFO - Verified Pod ctest-pod-67432069 in agent 10.0.0.34
2024-11-13 12:40:19,981 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=686cdc05-e0a9-4e90-b71f-0dffac0c1984
2024-11-13 12:40:19,988 - INFO - Pod ctest-pod-67432069 with uuid 686cdc05-e0a9-4e90-b71f-0dffac0c1984 found in kube manager
2024-11-13 12:40:19,988 - INFO - Pod ctest-pod-67432069 verification passed
2024-11-13 12:40:19,998 - INFO - Pod ctest-pod-15896055 is in running state.Got IP 10.47.255.244
2024-11-13 12:40:20,020 - DEBUG - Pod ctest-pod-15896055 has vmi 6a1162dc-a1bc-11ef-bc9e-fa163e5b8c8d
2024-11-13 12:40:20,020 - INFO - Verified pod ctest-pod-15896055 in contrail-api
2024-11-13 12:40:20,039 - DEBUG - VMI 6a1162dc-a1bc-11ef-bc9e-fa163e5b8c8d is active in agent 10.0.0.34
2024-11-13 12:40:20,040 - INFO - Verified Pod ctest-pod-15896055 in agent 10.0.0.34
2024-11-13 12:40:20,040 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=c7f36722-b14e-4ba9-ba34-bc6655e16365
2024-11-13 12:40:20,048 - INFO - Pod ctest-pod-15896055 with uuid c7f36722-b14e-4ba9-ba34-bc6655e16365 found in kube manager
2024-11-13 12:40:20,048 - INFO - Pod ctest-pod-15896055 verification passed
2024-11-13 12:40:20,048 - INFO - ================================================================================
2024-11-13 12:40:20,048 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-11-13 12:40:20,048 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-11-13 12:40:20,262 - DEBUG - Nothing to compare xmpp stats {'10.0.0.34': {'10.0.0.17': '0'}} with
2024-11-13 12:40:20,262 - INFO - Initial checks done. Running the testcase now
2024-11-13 12:40:20,262 - INFO -
2024-11-13 12:40:20,343 - DEBUG - [Pod ctest-pod-62831488] Cmd: echo ctest-pod-62831488 > /usr/share/nginx/html/index.html, Output:
2024-11-13 12:40:20,417 - DEBUG - [Pod ctest-pod-04091860] Cmd: echo ctest-pod-04091860 > /usr/share/nginx/html/index.html, Output:
2024-11-13 12:40:20,482 - DEBUG - [Pod ctest-pod-95194136] Cmd: echo ctest-pod-95194136 > /usr/share/nginx/html/index.html, Output:
2024-11-13 12:40:20,546 - DEBUG - [Pod ctest-pod-15197728] Cmd: echo ctest-pod-15197728 > /usr/share/nginx/html/index.html, Output:
2024-11-13 12:40:20,550 - DEBUG - Service ctest-nginx-svc-04896458 not present
2024-11-13 12:40:20,550 - INFO - Creating service ctest-nginx-svc-04896458
2024-11-13 12:40:20,577 - INFO - Created Service ctest-nginx-svc-04896458
2024-11-13 12:40:20,597 - WARNING - Service UUID daffa355-b3ec-42bf-a37a-43178bc78422 not yet found in contrail-api
2024-11-13 12:40:21,624 - INFO - Validated that Service ctest-nginx-svc-04896458 is seen in contrail-api
2024-11-13 12:40:21,624 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_LoadbalancerDatabaseList?x=daffa355-b3ec-42bf-a37a-43178bc78422
2024-11-13 12:40:21,630 - INFO - Service ctest-nginx-svc-04896458 with uuid daffa355-b3ec-42bf-a37a-43178bc78422 found in kube manager
2024-11-13 12:40:21,630 - INFO - Service ctest-nginx-svc-04896458 verification passed
2024-11-13 12:40:22,703 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
ctest-pod-62831488
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:40:22,703 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:40:22,703 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
ctest-pod-62831488
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:40:22,777 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62831488
2024-11-13 12:40:22,778 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:40:22,778 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62831488
2024-11-13 12:40:22,847 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:40:22,847 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:40:22,847 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:40:22,847 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62831488': 2, 'ctest-pod-04091860': 1}
2024-11-13 12:40:22,908 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:40:22,908 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:40:22,908 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:40:22,974 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:40:22,974 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:40:22,974 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:40:23,032 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
ctest-pod-62831488
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:40:23,032 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:40:23,032 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
ctest-pod-62831488
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:40:23,032 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62831488': 1, 'ctest-pod-04091860': 2}
2024-11-13 12:40:23,036 - DEBUG - Network policy ingress-on-service not present
2024-11-13 12:40:23,037 - INFO - Creating Network Policy ingress-on-service
2024-11-13 12:40:23,052 - INFO - Network policy found in k8s
2024-11-13 12:40:23,053 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f44645ba-6be6-4a75-874e-0178ed22384f
2024-11-13 12:40:23,061 - INFO - Network Policy ingress-on-service with uuid f44645ba-6be6-4a75-874e-0178ed22384f found in kube manager
2024-11-13 12:40:23,098 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-11-13 12:40:23,098 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-11-13 12:40:23,099 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f44645ba-6be6-4a75-874e-0178ed22384f
2024-11-13 12:40:23,135 - WARNING - Network policy with name ingress-on-service not found in agent
2024-11-13 12:40:25,136 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f44645ba-6be6-4a75-874e-0178ed22384f
2024-11-13 12:40:25,170 - INFO - Network policy with name ingress-on-service found in agent
2024-11-13 12:40:25,170 - INFO - Network Policy ingress-on-service verification passed
2024-11-13 12:40:30,240 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:30,241 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:30,241 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:35,312 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:35,312 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:35,312 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:40,377 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:40,377 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:40,377 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:45,431 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:45,431 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:45,431 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:50,485 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:50,485 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:50,485 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:55,552 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:55,552 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:40:55,552 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:00,615 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:00,615 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:00,615 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:05,688 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:05,688 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:05,688 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:10,753 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:10,753 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:10,753 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:15,816 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:15,816 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:15,816 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:15,816 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62831488': 0, 'ctest-pod-04091860': 0}
2024-11-13 12:41:15,884 - DEBUG - [Pod ctest-pod-67432069] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:41:15,884 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:41:15,884 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:41:15,950 - DEBUG - [Pod ctest-pod-67432069] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
ctest-pod-62831488
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:41:15,950 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:41:15,950 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
ctest-pod-62831488
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:41:15,950 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62831488': 1, 'ctest-pod-04091860': 1}
2024-11-13 12:41:21,017 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:21,017 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:21,017 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:26,069 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:26,069 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:26,069 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:31,127 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:31,127 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:31,127 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:36,195 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:36,195 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:36,195 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:41,247 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:41,247 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:41,247 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:46,321 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:46,322 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:46,322 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:51,381 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:51,381 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:51,381 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:56,436 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:56,436 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:41:56,436 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:01,493 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:01,493 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:01,493 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:06,548 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:06,548 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:06,548 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:06,548 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62831488': 0, 'ctest-pod-04091860': 0}
2024-11-13 12:42:08,731 - DEBUG - [Pod ctest-pod-67432069] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.525 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.568/1.525 ms
2024-11-13 12:42:08,731 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-67432069 with expectation True passed
2024-11-13 12:42:10,808 - DEBUG - [Pod ctest-pod-28312880] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.548 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.238/0.548 ms
2024-11-13 12:42:10,808 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-28312880 with expectation True passed
2024-11-13 12:42:12,876 - DEBUG - [Pod ctest-pod-79281087] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.586 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.590/1.586 ms
2024-11-13 12:42:12,876 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-79281087 with expectation True passed
2024-11-13 12:42:12,949 - DEBUG - [Pod ctest-pod-67432069] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-13 12:42:12,950 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-11-13 12:42:12,950 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-13 12:42:12,950 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67432069 passed
2024-11-13 12:42:13,021 - DEBUG - [Pod ctest-pod-67432069] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-13 12:42:13,021 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-11-13 12:42:13,022 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-13 12:42:13,022 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67432069 passed
2024-11-13 12:42:18,098 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-13 12:42:18,098 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-13 12:42:18,098 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-13 12:42:18,098 - INFO - wget check of of http://10.47.255.250 from ctest-pod-28312880 passed
2024-11-13 12:42:22,061 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2024-11-13 12:42:32,122 - DEBUG - [Pod ctest-pod-15896055] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-11-13 12:42:32,123 - DEBUG - [Pod Pod ctest-pod-15896055] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-11-13 12:42:32,123 - DEBUG - [Pod Pod ctest-pod-15896055] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-11-13 12:42:32,123 - INFO - wget check of of http://10.47.255.251 from ctest-pod-15896055 passed
2024-11-13 12:42:32,130 - INFO - Updating Network Policy ingress-on-service
2024-11-13 12:42:37,196 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:37,196 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:37,196 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:42,256 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:42,256 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:42,256 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:47,315 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:47,315 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:47,315 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:52,379 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:52,379 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:52,379 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:57,446 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:57,447 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:42:57,447 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:02,506 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:02,506 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:02,506 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:07,575 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:07,575 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:07,575 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:12,648 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:12,648 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:12,648 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:17,708 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:17,708 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:17,708 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:22,780 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:22,780 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:22,780 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
wget: download timed out
2024-11-13 12:43:22,780 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62831488': 0, 'ctest-pod-04091860': 0}
2024-11-13 12:43:22,844 - DEBUG - [Pod ctest-pod-67432069] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:43:22,844 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:43:22,844 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:43:22,919 - DEBUG - [Pod ctest-pod-67432069] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-62831488
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:43:22,919 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:43:22,919 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd output: ctest-pod-62831488
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:43:22,919 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62831488': 1, 'ctest-pod-04091860': 1}
2024-11-13 12:43:22,975 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:43:22,975 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:43:22,975 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: ctest-pod-04091860
Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-13 12:43:23,055 - DEBUG - [Pod ctest-pod-79281087] Cmd: wget http://10.100.103.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62831488
2024-11-13 12:43:23,055 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd wget http://10.100.103.233:80/ -O - -T 5 -t 1 passed
2024-11-13 12:43:23,055 - DEBUG - [Pod Pod ctest-pod-79281087] Cmd output: Connecting to 10.100.103.233:80 (10.100.103.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62831488
2024-11-13 12:43:23,055 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62831488': 1, 'ctest-pod-04091860': 1}
2024-11-13 12:43:25,118 - DEBUG - [Pod ctest-pod-67432069] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.737 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.302/0.737 ms
2024-11-13 12:43:25,118 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-67432069 with expectation True passed
2024-11-13 12:43:27,183 - DEBUG - [Pod ctest-pod-28312880] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.012 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.397/1.012 ms
2024-11-13 12:43:27,183 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-28312880 with expectation True passed
2024-11-13 12:43:29,247 - DEBUG - [Pod ctest-pod-79281087] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.730 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.299/0.730 ms
2024-11-13 12:43:29,247 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-79281087 with expectation True passed
2024-11-13 12:43:29,305 - DEBUG - [Pod ctest-pod-67432069] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-13 12:43:29,305 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-11-13 12:43:29,306 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-13 12:43:29,306 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67432069 passed
2024-11-13 12:43:29,378 - DEBUG - [Pod ctest-pod-67432069] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-13 12:43:29,378 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-11-13 12:43:29,378 - DEBUG - [Pod Pod ctest-pod-67432069] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-13 12:43:29,378 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67432069 passed
2024-11-13 12:43:34,607 - DEBUG - [Pod ctest-pod-28312880] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-13 12:43:34,608 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-13 12:43:34,608 - DEBUG - [Pod Pod ctest-pod-28312880] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-13 12:43:34,608 - INFO - wget check of of http://10.47.255.250 from ctest-pod-28312880 passed
2024-11-13 12:43:34,690 - DEBUG - [Pod ctest-pod-15896055] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-13 12:43:34,690 - DEBUG - [Pod Pod ctest-pod-15896055] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-11-13 12:43:34,690 - DEBUG - [Pod Pod ctest-pod-15896055] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-13 12:43:34,690 - INFO - wget check of of http://10.47.255.251 from ctest-pod-15896055 passed
2024-11-13 12:43:34,690 - INFO - Deleting Network Policy : ingress-on-service
2024-11-13 12:43:34,691 - INFO - Deleting service : ctest-nginx-svc-04896458
2024-11-13 12:43:34,893 - DEBUG - No XMPP flaps were noticed during the test
2024-11-13 12:43:34,893 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2024-11-13 12:43:34,893 - INFO - --------------------------------------------------------------------------------
2024-11-13 12:43:34,899 - INFO - Deleting pod ctest-new-default-71787371:ctest-pod-62831488
2024-11-13 12:43:34,899 - INFO - Deleting pod ctest-new-default-71787371:ctest-pod-04091860
2024-11-13 12:43:34,900 - INFO - Deleting pod ctest-non-default-99615177:ctest-pod-95194136
2024-11-13 12:43:34,900 - INFO - Deleting pod ctest-non-default-99615177:ctest-pod-15197728
2024-11-13 12:43:34,901 - INFO - Deleting pod ctest-new-default-71787371:ctest-pod-28312880
2024-11-13 12:43:34,901 - INFO - Deleting pod ctest-new-default-71787371:ctest-pod-67432069
2024-11-13 12:43:34,901 - INFO - Deleting pod ctest-non-default-99615177:ctest-pod-79281087
2024-11-13 12:43:34,901 - INFO - Deleting pod ctest-non-default-99615177:ctest-pod-15896055
2024-11-13 12:43:35,096 - WARNING - Pod uuid 08db7c4d-ce20-44fb-82df-5191577bd58e is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:35,192 - WARNING - Pod uuid 1075662c-fc9c-49ec-a7de-b470f4810b16 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:35,218 - WARNING - Pod uuid b087334e-005a-447a-bfd0-e634c284a629 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:35,219 - WARNING - Pod uuid 686cdc05-e0a9-4e90-b71f-0dffac0c1984 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:35,221 - WARNING - Pod uuid d985f6a9-7765-485f-83e8-fdd2c93af5ea is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:35,221 - WARNING - Pod uuid c7f36722-b14e-4ba9-ba34-bc6655e16365 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:35,221 - WARNING - Pod uuid bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:35,222 - WARNING - Pod uuid bed8f0d0-4dcb-4dcd-bf2e-efcf12b8e014 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:40,107 - WARNING - Pod uuid 08db7c4d-ce20-44fb-82df-5191577bd58e is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:40,202 - DEBUG - Pod 1075662c-fc9c-49ec-a7de-b470f4810b16 is not in agent 10.0.0.34 VM list
2024-11-13 12:43:40,213 - DEBUG - VMI 65daee2c-a1bc-11ef-bc9e-fa163e5b8c8d is removed from agent 10.0.0.34
2024-11-13 12:43:40,213 - INFO - Verified that pod ctest-pod-62831488 is removed in agent
2024-11-13 12:43:40,251 - WARNING - Pod uuid bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:40,251 - WARNING - Pod uuid c7f36722-b14e-4ba9-ba34-bc6655e16365 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:40,253 - WARNING - Pod uuid 686cdc05-e0a9-4e90-b71f-0dffac0c1984 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:40,255 - DEBUG - Pod b087334e-005a-447a-bfd0-e634c284a629 is not in agent 10.0.0.34 VM list
2024-11-13 12:43:40,257 - DEBUG - Pod bed8f0d0-4dcb-4dcd-bf2e-efcf12b8e014 is not in agent 10.0.0.34 VM list
2024-11-13 12:43:40,259 - DEBUG - Pod d985f6a9-7765-485f-83e8-fdd2c93af5ea is not in agent 10.0.0.34 VM list
2024-11-13 12:43:40,283 - DEBUG - VMI 6682897a-a1bc-11ef-bc9e-fa163e5b8c8d is removed from agent 10.0.0.34
2024-11-13 12:43:40,283 - INFO - Verified that pod ctest-pod-04091860 is removed in agent
2024-11-13 12:43:40,283 - DEBUG - VMI 673e9c0a-a1bc-11ef-bc9e-fa163e5b8c8d is removed from agent 10.0.0.34
2024-11-13 12:43:40,283 - INFO - Verified that pod ctest-pod-95194136 is removed in agent
2024-11-13 12:43:40,284 - DEBUG - VMI 67d1c46c-a1bc-11ef-bc9e-fa163e5b8c8d is removed from agent 10.0.0.34
2024-11-13 12:43:40,284 - INFO - Verified that pod ctest-pod-15197728 is removed in agent
2024-11-13 12:43:45,116 - WARNING - Pod uuid 08db7c4d-ce20-44fb-82df-5191577bd58e is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:45,281 - WARNING - Pod uuid 686cdc05-e0a9-4e90-b71f-0dffac0c1984 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:45,282 - WARNING - Pod uuid c7f36722-b14e-4ba9-ba34-bc6655e16365 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:45,283 - WARNING - Pod uuid bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:50,126 - WARNING - Pod uuid 08db7c4d-ce20-44fb-82df-5191577bd58e is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:50,298 - WARNING - Pod uuid 686cdc05-e0a9-4e90-b71f-0dffac0c1984 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:50,300 - WARNING - Pod uuid c7f36722-b14e-4ba9-ba34-bc6655e16365 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:50,300 - WARNING - Pod uuid bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:55,135 - WARNING - Pod uuid 08db7c4d-ce20-44fb-82df-5191577bd58e is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:55,316 - WARNING - Pod uuid c7f36722-b14e-4ba9-ba34-bc6655e16365 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:55,317 - WARNING - Pod uuid 686cdc05-e0a9-4e90-b71f-0dffac0c1984 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:43:55,317 - WARNING - Pod uuid bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb is still seen in agent 10.0.0.34 VM list
2024-11-13 12:44:00,144 - WARNING - Pod uuid 08db7c4d-ce20-44fb-82df-5191577bd58e is still seen in agent 10.0.0.34 VM list
2024-11-13 12:44:00,333 - WARNING - Pod uuid c7f36722-b14e-4ba9-ba34-bc6655e16365 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:44:00,335 - WARNING - Pod uuid bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb is still seen in agent 10.0.0.34 VM list
2024-11-13 12:44:00,336 - WARNING - Pod uuid 686cdc05-e0a9-4e90-b71f-0dffac0c1984 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:44:05,160 - WARNING - Pod uuid 08db7c4d-ce20-44fb-82df-5191577bd58e is still seen in agent 10.0.0.34 VM list
2024-11-13 12:44:05,354 - WARNING - Pod uuid bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb is still seen in agent 10.0.0.34 VM list
2024-11-13 12:44:05,357 - WARNING - Pod uuid 686cdc05-e0a9-4e90-b71f-0dffac0c1984 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:44:05,357 - WARNING - Pod uuid c7f36722-b14e-4ba9-ba34-bc6655e16365 is still seen in agent 10.0.0.34 VM list
2024-11-13 12:44:10,169 - DEBUG - Pod 08db7c4d-ce20-44fb-82df-5191577bd58e is not in agent 10.0.0.34 VM list
2024-11-13 12:44:10,175 - DEBUG - VMI 698ed16e-a1bc-11ef-bc9e-fa163e5b8c8d is removed from agent 10.0.0.34
2024-11-13 12:44:10,175 - INFO - Verified that pod ctest-pod-79281087 is removed in agent
2024-11-13 12:44:10,371 - DEBUG - Pod bf7b27d2-d83a-4a77-8b7c-a2810bfda8eb is not in agent 10.0.0.34 VM list
2024-11-13 12:44:10,374 - DEBUG - Pod c7f36722-b14e-4ba9-ba34-bc6655e16365 is not in agent 10.0.0.34 VM list
2024-11-13 12:44:10,375 - DEBUG - Pod 686cdc05-e0a9-4e90-b71f-0dffac0c1984 is not in agent 10.0.0.34 VM list
2024-11-13 12:44:10,386 - DEBUG - VMI 687ba25c-a1bc-11ef-bc9e-fa163e5b8c8d is removed from agent 10.0.0.34
2024-11-13 12:44:10,386 - INFO - Verified that pod ctest-pod-28312880 is removed in agent
2024-11-13 12:44:10,388 - DEBUG - VMI 6906d62e-a1bc-11ef-bc9e-fa163e5b8c8d is removed from agent 10.0.0.34
2024-11-13 12:44:10,388 - INFO - Verified that pod ctest-pod-67432069 is removed in agent
2024-11-13 12:44:10,388 - DEBUG - VMI 6a1162dc-a1bc-11ef-bc9e-fa163e5b8c8d is removed from agent 10.0.0.34
2024-11-13 12:44:10,388 - INFO - Verified that pod ctest-pod-15896055 is removed in agent
2024-11-13 12:44:10,388 - INFO - Deleting namespace ctest-non-default-99615177
2024-11-13 12:44:10,413 - DEBUG - Namespace ctest-non-default-99615177 still in k8s
2024-11-13 12:44:12,418 - DEBUG - Namespace ctest-non-default-99615177 still in k8s
2024-11-13 12:44:14,423 - DEBUG - Namespace ctest-non-default-99615177 still in k8s
2024-11-13 12:44:16,428 - DEBUG - Namespace ctest-non-default-99615177 is not in k8s
2024-11-13 12:44:16,428 - DEBUG - No need to check project deletion in contrail-api
2024-11-13 12:44:16,428 - INFO - Deleting namespace ctest-new-default-71787371
2024-11-13 12:44:16,439 - DEBUG - Namespace ctest-new-default-71787371 still in k8s
2024-11-13 12:44:18,443 - DEBUG - Namespace ctest-new-default-71787371 still in k8s
2024-11-13 12:44:20,449 - DEBUG - Namespace ctest-new-default-71787371 still in k8s
2024-11-13 12:44:22,454 - DEBUG - Namespace ctest-new-default-71787371 is not in k8s
2024-11-13 12:44:22,454 - DEBUG - No need to check project deletion in contrail-api