2024-10-24 02:13:53,729 - INFO - Using existing project ['default-domain', 'k8s-default'](4098035f-c19d-4767-8585-192b56777881)
2024-10-24 02:13:53,753 - DEBUG - Namespace ctest-new-default-97093252 not present
2024-10-24 02:13:53,760 - INFO - Created namespace ctest-new-default-97093252
2024-10-24 02:13:56,764 - DEBUG - Namespace ctest-non-default-78361514 not present
2024-10-24 02:13:56,772 - INFO - Created namespace ctest-non-default-78361514
2024-10-24 02:13:59,790 - DEBUG - Pod ctest-pod-75459877 not present
2024-10-24 02:13:59,791 - INFO - Creating Pod ctest-pod-75459877
2024-10-24 02:13:59,806 - DEBUG - Pod : ctest-pod-75459877 UUID is b7938d08-03ee-4461-92cd-2aed4845617e
2024-10-24 02:13:59,812 - DEBUG - Pod ctest-pod-68994293 not present
2024-10-24 02:13:59,812 - INFO - Creating Pod ctest-pod-68994293
2024-10-24 02:13:59,828 - DEBUG - Pod : ctest-pod-68994293 UUID is f287e80d-4264-45b3-95d2-c802b298c35e
2024-10-24 02:13:59,830 - DEBUG - Pod ctest-pod-31252218 not present
2024-10-24 02:13:59,830 - INFO - Creating Pod ctest-pod-31252218
2024-10-24 02:13:59,853 - DEBUG - Pod : ctest-pod-31252218 UUID is 92ea2338-02b1-4c8c-a50e-32c47c1fd537
2024-10-24 02:13:59,858 - DEBUG - Pod ctest-pod-34360593 not present
2024-10-24 02:13:59,858 - INFO - Creating Pod ctest-pod-34360593
2024-10-24 02:13:59,877 - DEBUG - Pod : ctest-pod-34360593 UUID is 1468d9a1-07fb-4761-b97b-2e1530fd577e
2024-10-24 02:13:59,881 - DEBUG - Pod ctest-pod-38547327 not present
2024-10-24 02:13:59,881 - INFO - Creating Pod ctest-pod-38547327
2024-10-24 02:13:59,902 - DEBUG - Pod : ctest-pod-38547327 UUID is 526a3041-7ebe-406b-abf7-4a34b5a918b9
2024-10-24 02:13:59,906 - DEBUG - Pod ctest-pod-75540013 not present
2024-10-24 02:13:59,906 - INFO - Creating Pod ctest-pod-75540013
2024-10-24 02:13:59,933 - DEBUG - Pod : ctest-pod-75540013 UUID is 35c9d9f1-688e-4b7a-8002-d84ec5094b6e
2024-10-24 02:13:59,938 - DEBUG - Pod ctest-pod-39154328 not present
2024-10-24 02:13:59,938 - INFO - Creating Pod ctest-pod-39154328
2024-10-24 02:13:59,963 - DEBUG - Pod : ctest-pod-39154328 UUID is 9ed167ea-4e49-46ac-8d62-7a77e878f502
2024-10-24 02:13:59,969 - DEBUG - Pod ctest-pod-14858385 not present
2024-10-24 02:13:59,970 - INFO - Creating Pod ctest-pod-14858385
2024-10-24 02:13:59,993 - DEBUG - Pod : ctest-pod-14858385 UUID is 6b0c0e37-969b-4d4f-8198-92687ca941a7
2024-10-24 02:14:00,342 - INFO - Project default-domain:k8s-ctest-new-default-97093252 for Namespace ctest-new-default-97093252 is seen in contrail-api
2024-10-24 02:14:00,342 - DEBUG - Project uuid in Contrail is defedd29-c03e-4e10-8de2-314bbc076867
2024-10-24 02:14:00,626 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=b0999c5c-9ca5-4185-a42c-d5fde01b5717
2024-10-24 02:14:00,631 - INFO - Namespace ctest-new-default-97093252 with uuid b0999c5c-9ca5-4185-a42c-d5fde01b5717 found in kube manager
2024-10-24 02:14:00,632 - INFO - Namespace ctest-new-default-97093252 verification passed
2024-10-24 02:14:01,078 - INFO - Project default-domain:k8s-ctest-non-default-78361514 for Namespace ctest-non-default-78361514 is seen in contrail-api
2024-10-24 02:14:01,079 - DEBUG - Project uuid in Contrail is bb543bf3-7f78-4563-9d95-a14d6e772c7d
2024-10-24 02:14:01,079 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=566bf720-e6cb-448c-bd22-d87d0ce60486
2024-10-24 02:14:01,092 - INFO - Namespace ctest-non-default-78361514 with uuid 566bf720-e6cb-448c-bd22-d87d0ce60486 found in kube manager
2024-10-24 02:14:01,092 - INFO - Namespace ctest-non-default-78361514 verification passed
2024-10-24 02:14:01,113 - DEBUG - Pod ctest-pod-75459877 not in running state.Currently in Pending
2024-10-24 02:14:06,125 - DEBUG - Pod ctest-pod-75459877 not in running state.Currently in Pending
2024-10-24 02:14:11,133 - DEBUG - Pod ctest-pod-75459877 not in running state.Currently in Pending
2024-10-24 02:14:16,201 - INFO - Pod ctest-pod-75459877 is in running state.Got IP 10.47.255.250
2024-10-24 02:14:16,276 - DEBUG - Pod ctest-pod-75459877 has vmi a3a98336-91ad-11ef-a76b-0242dd17919e
2024-10-24 02:14:16,276 - INFO - Verified pod ctest-pod-75459877 in contrail-api
2024-10-24 02:14:16,290 - DEBUG - VMI a3a98336-91ad-11ef-a76b-0242dd17919e is active in agent 10.0.0.37
2024-10-24 02:14:16,291 - INFO - Verified Pod ctest-pod-75459877 in agent 10.0.0.37
2024-10-24 02:14:16,291 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=b7938d08-03ee-4461-92cd-2aed4845617e
2024-10-24 02:14:16,298 - INFO - Pod ctest-pod-75459877 with uuid b7938d08-03ee-4461-92cd-2aed4845617e found in kube manager
2024-10-24 02:14:16,298 - INFO - Pod ctest-pod-75459877 verification passed
2024-10-24 02:14:16,304 - INFO - Pod ctest-pod-68994293 is in running state.Got IP 10.47.255.249
2024-10-24 02:14:16,402 - DEBUG - Pod ctest-pod-68994293 has vmi a446d7bc-91ad-11ef-a76b-0242dd17919e
2024-10-24 02:14:16,402 - INFO - Verified pod ctest-pod-68994293 in contrail-api
2024-10-24 02:14:16,416 - DEBUG - VMI a446d7bc-91ad-11ef-a76b-0242dd17919e is active in agent 10.0.0.37
2024-10-24 02:14:16,416 - INFO - Verified Pod ctest-pod-68994293 in agent 10.0.0.37
2024-10-24 02:14:16,416 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=f287e80d-4264-45b3-95d2-c802b298c35e
2024-10-24 02:14:16,420 - INFO - Pod ctest-pod-68994293 with uuid f287e80d-4264-45b3-95d2-c802b298c35e found in kube manager
2024-10-24 02:14:16,420 - INFO - Pod ctest-pod-68994293 verification passed
2024-10-24 02:14:16,426 - DEBUG - Pod ctest-pod-31252218 not in running state.Currently in Pending
2024-10-24 02:14:21,435 - INFO - Pod ctest-pod-31252218 is in running state.Got IP 10.47.255.248
2024-10-24 02:14:21,504 - DEBUG - Pod ctest-pod-31252218 has vmi a578d1a8-91ad-11ef-a76b-0242dd17919e
2024-10-24 02:14:21,504 - INFO - Verified pod ctest-pod-31252218 in contrail-api
2024-10-24 02:14:21,517 - DEBUG - VMI a578d1a8-91ad-11ef-a76b-0242dd17919e is active in agent 10.0.0.37
2024-10-24 02:14:21,517 - INFO - Verified Pod ctest-pod-31252218 in agent 10.0.0.37
2024-10-24 02:14:21,517 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=92ea2338-02b1-4c8c-a50e-32c47c1fd537
2024-10-24 02:14:21,524 - INFO - Pod ctest-pod-31252218 with uuid 92ea2338-02b1-4c8c-a50e-32c47c1fd537 found in kube manager
2024-10-24 02:14:21,524 - INFO - Pod ctest-pod-31252218 verification passed
2024-10-24 02:14:21,532 - INFO - Pod ctest-pod-34360593 is in running state.Got IP 10.47.255.247
2024-10-24 02:14:21,633 - DEBUG - Pod ctest-pod-34360593 has vmi a63acfa6-91ad-11ef-a76b-0242dd17919e
2024-10-24 02:14:21,633 - INFO - Verified pod ctest-pod-34360593 in contrail-api
2024-10-24 02:14:21,646 - DEBUG - VMI a63acfa6-91ad-11ef-a76b-0242dd17919e is active in agent 10.0.0.37
2024-10-24 02:14:21,647 - INFO - Verified Pod ctest-pod-34360593 in agent 10.0.0.37
2024-10-24 02:14:21,647 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=1468d9a1-07fb-4761-b97b-2e1530fd577e
2024-10-24 02:14:21,651 - INFO - Pod ctest-pod-34360593 with uuid 1468d9a1-07fb-4761-b97b-2e1530fd577e found in kube manager
2024-10-24 02:14:21,651 - INFO - Pod ctest-pod-34360593 verification passed
2024-10-24 02:14:21,657 - INFO - Pod ctest-pod-38547327 is in running state.Got IP 10.47.255.246
2024-10-24 02:14:21,754 - DEBUG - Pod ctest-pod-38547327 has vmi a6f56c08-91ad-11ef-a76b-0242dd17919e
2024-10-24 02:14:21,754 - INFO - Verified pod ctest-pod-38547327 in contrail-api
2024-10-24 02:14:21,765 - DEBUG - VMI a6f56c08-91ad-11ef-a76b-0242dd17919e is active in agent 10.0.0.37
2024-10-24 02:14:21,766 - INFO - Verified Pod ctest-pod-38547327 in agent 10.0.0.37
2024-10-24 02:14:21,766 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=526a3041-7ebe-406b-abf7-4a34b5a918b9
2024-10-24 02:14:21,770 - INFO - Pod ctest-pod-38547327 with uuid 526a3041-7ebe-406b-abf7-4a34b5a918b9 found in kube manager
2024-10-24 02:14:21,770 - INFO - Pod ctest-pod-38547327 verification passed
2024-10-24 02:14:21,777 - DEBUG - Pod ctest-pod-39154328 not in running state.Currently in Pending
2024-10-24 02:14:26,783 - INFO - Pod ctest-pod-39154328 is in running state.Got IP 10.47.255.244
2024-10-24 02:14:26,839 - DEBUG - Pod ctest-pod-39154328 has vmi a8bed1fa-91ad-11ef-a76b-0242dd17919e
2024-10-24 02:14:26,839 - INFO - Verified pod ctest-pod-39154328 in contrail-api
2024-10-24 02:14:26,850 - DEBUG - VMI a8bed1fa-91ad-11ef-a76b-0242dd17919e is active in agent 10.0.0.37
2024-10-24 02:14:26,851 - INFO - Verified Pod ctest-pod-39154328 in agent 10.0.0.37
2024-10-24 02:14:26,851 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=9ed167ea-4e49-46ac-8d62-7a77e878f502
2024-10-24 02:14:26,855 - INFO - Pod ctest-pod-39154328 with uuid 9ed167ea-4e49-46ac-8d62-7a77e878f502 found in kube manager
2024-10-24 02:14:26,855 - INFO - Pod ctest-pod-39154328 verification passed
2024-10-24 02:14:26,861 - INFO - Pod ctest-pod-75540013 is in running state.Got IP 10.47.255.245
2024-10-24 02:14:26,957 - DEBUG - Pod ctest-pod-75540013 has vmi a7eba2da-91ad-11ef-a76b-0242dd17919e
2024-10-24 02:14:26,957 - INFO - Verified pod ctest-pod-75540013 in contrail-api
2024-10-24 02:14:26,969 - DEBUG - VMI a7eba2da-91ad-11ef-a76b-0242dd17919e is active in agent 10.0.0.37
2024-10-24 02:14:26,970 - INFO - Verified Pod ctest-pod-75540013 in agent 10.0.0.37
2024-10-24 02:14:26,970 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=35c9d9f1-688e-4b7a-8002-d84ec5094b6e
2024-10-24 02:14:26,974 - INFO - Pod ctest-pod-75540013 with uuid 35c9d9f1-688e-4b7a-8002-d84ec5094b6e found in kube manager
2024-10-24 02:14:26,974 - INFO - Pod ctest-pod-75540013 verification passed
2024-10-24 02:14:26,980 - INFO - Pod ctest-pod-14858385 is in running state.Got IP 10.47.255.243
2024-10-24 02:14:27,077 - DEBUG - Pod ctest-pod-14858385 has vmi a98e8ab2-91ad-11ef-a76b-0242dd17919e
2024-10-24 02:14:27,077 - INFO - Verified pod ctest-pod-14858385 in contrail-api
2024-10-24 02:14:27,088 - DEBUG - VMI a98e8ab2-91ad-11ef-a76b-0242dd17919e is active in agent 10.0.0.37
2024-10-24 02:14:27,088 - INFO - Verified Pod ctest-pod-14858385 in agent 10.0.0.37
2024-10-24 02:14:27,089 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=6b0c0e37-969b-4d4f-8198-92687ca941a7
2024-10-24 02:14:27,093 - INFO - Pod ctest-pod-14858385 with uuid 6b0c0e37-969b-4d4f-8198-92687ca941a7 found in kube manager
2024-10-24 02:14:27,093 - INFO - Pod ctest-pod-14858385 verification passed
2024-10-24 02:14:27,094 - INFO - ================================================================================
2024-10-24 02:14:27,094 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-10-24 02:14:27,094 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-10-24 02:14:27,340 - DEBUG - Nothing to compare xmpp stats {'10.0.0.37': {'10.0.0.37': '2'}} with
2024-10-24 02:14:27,341 - INFO - Initial checks done. Running the testcase now
2024-10-24 02:14:27,341 - INFO -
2024-10-24 02:14:27,421 - DEBUG - [Pod ctest-pod-75459877] Cmd: echo ctest-pod-75459877 > /usr/share/nginx/html/index.html, Output:
2024-10-24 02:14:27,496 - DEBUG - [Pod ctest-pod-68994293] Cmd: echo ctest-pod-68994293 > /usr/share/nginx/html/index.html, Output:
2024-10-24 02:14:27,572 - DEBUG - [Pod ctest-pod-31252218] Cmd: echo ctest-pod-31252218 > /usr/share/nginx/html/index.html, Output:
2024-10-24 02:14:27,646 - DEBUG - [Pod ctest-pod-34360593] Cmd: echo ctest-pod-34360593 > /usr/share/nginx/html/index.html, Output:
2024-10-24 02:14:27,649 - DEBUG - Service ctest-nginx-svc-65033198 not present
2024-10-24 02:14:27,649 - INFO - Creating service ctest-nginx-svc-65033198
2024-10-24 02:14:27,663 - INFO - Created Service ctest-nginx-svc-65033198
2024-10-24 02:14:27,674 - WARNING - Service UUID 03ca49e4-ab91-4846-80a5-33a072e7c1d1 not yet found in contrail-api
2024-10-24 02:14:28,694 - INFO - Validated that Service ctest-nginx-svc-65033198 is seen in contrail-api
2024-10-24 02:14:28,695 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_LoadbalancerDatabaseList?x=03ca49e4-ab91-4846-80a5-33a072e7c1d1
2024-10-24 02:14:28,699 - INFO - Service ctest-nginx-svc-65033198 with uuid 03ca49e4-ab91-4846-80a5-33a072e7c1d1 found in kube manager
2024-10-24 02:14:28,699 - INFO - Service ctest-nginx-svc-65033198 verification passed
2024-10-24 02:14:29,832 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
ctest-pod-75459877
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:14:29,832 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:14:29,832 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
ctest-pod-75459877
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:14:29,924 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
ctest-pod-75459877
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:14:29,924 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:14:29,924 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
ctest-pod-75459877
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:14:30,014 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-68994293
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:14:30,015 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:14:30,015 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-68994293
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:14:30,015 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-75459877': 2, 'ctest-pod-68994293': 1}
2024-10-24 02:14:30,099 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-75459877
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:14:30,099 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:14:30,099 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-75459877
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:14:30,178 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-68994293
Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:14:30,178 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:14:30,178 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: ctest-pod-68994293
Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:14:30,178 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-75459877': 1, 'ctest-pod-68994293': 1}
2024-10-24 02:14:30,182 - DEBUG - Network policy ingress-on-service not present
2024-10-24 02:14:30,182 - INFO - Creating Network Policy ingress-on-service
2024-10-24 02:14:30,194 - INFO - Network policy found in k8s
2024-10-24 02:14:30,194 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1618b968-1a06-47cc-bad8-a3813b5aed0f
2024-10-24 02:14:30,202 - INFO - Network Policy ingress-on-service with uuid 1618b968-1a06-47cc-bad8-a3813b5aed0f found in kube manager
2024-10-24 02:14:30,230 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-10-24 02:14:30,231 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-10-24 02:14:30,231 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1618b968-1a06-47cc-bad8-a3813b5aed0f
2024-10-24 02:14:30,258 - WARNING - Network policy with name ingress-on-service not found in agent
2024-10-24 02:14:32,258 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1618b968-1a06-47cc-bad8-a3813b5aed0f
2024-10-24 02:14:32,291 - WARNING - Network policy with name ingress-on-service not found in agent
2024-10-24 02:14:34,292 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1618b968-1a06-47cc-bad8-a3813b5aed0f
2024-10-24 02:14:34,323 - INFO - Network policy with name ingress-on-service found in agent
2024-10-24 02:14:34,323 - INFO - Network Policy ingress-on-service verification passed
2024-10-24 02:14:39,447 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:39,447 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:39,447 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:44,522 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:44,522 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:44,522 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:49,595 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:49,595 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:49,595 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:54,671 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:54,671 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:54,671 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:59,742 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:59,742 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:14:59,742 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:04,822 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:04,822 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:04,822 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:09,916 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:09,916 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:09,916 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:14,983 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:14,983 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:14,983 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:20,051 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:20,051 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:20,051 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:25,124 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:25,124 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:25,124 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:25,125 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-75459877': 0, 'ctest-pod-68994293': 0}
2024-10-24 02:15:25,208 - DEBUG - [Pod ctest-pod-75540013] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-68994293
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:15:25,209 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:15:25,209 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-68994293
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:15:25,288 - DEBUG - [Pod ctest-pod-75540013] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-68994293
2024-10-24 02:15:25,288 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:15:25,288 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-68994293
2024-10-24 02:15:25,358 - DEBUG - [Pod ctest-pod-75540013] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-75459877
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:15:25,359 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:15:25,359 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-75459877
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:15:25,359 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-75459877': 1, 'ctest-pod-68994293': 2}
2024-10-24 02:15:30,438 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:30,438 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:30,438 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:35,510 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:35,510 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:35,510 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:40,592 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:40,592 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:40,592 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:45,673 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:45,673 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:45,673 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:50,763 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:50,763 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:50,763 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:55,830 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:55,830 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:15:55,830 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:00,907 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:00,907 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:00,907 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:06,002 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:06,003 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:06,003 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:11,075 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:11,075 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:11,075 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:16,155 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:16,155 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:16,155 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:16,155 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-75459877': 0, 'ctest-pod-68994293': 0}
2024-10-24 02:16:18,251 - DEBUG - [Pod ctest-pod-75540013] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.977 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.066 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.066/0.371/0.977 ms
2024-10-24 02:16:18,251 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-75540013 with expectation True passed
2024-10-24 02:16:20,327 - DEBUG - [Pod ctest-pod-38547327] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.864 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.115 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.068 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.682/1.864 ms
2024-10-24 02:16:20,327 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-38547327 with expectation True passed
2024-10-24 02:16:22,403 - DEBUG - [Pod ctest-pod-39154328] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.916 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.061 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.061/0.349/0.916 ms
2024-10-24 02:16:22,403 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-39154328 with expectation True passed
2024-10-24 02:16:22,476 - DEBUG - [Pod ctest-pod-75540013] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:16:22,476 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-24 02:16:22,476 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:16:22,476 - INFO - wget check of of http://10.47.255.250 from ctest-pod-75540013 passed
2024-10-24 02:16:22,555 - DEBUG - [Pod ctest-pod-75540013] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:16:22,555 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2024-10-24 02:16:22,555 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:16:22,555 - INFO - wget check of of http://10.47.255.249 from ctest-pod-75540013 passed
2024-10-24 02:16:27,636 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-10-24 02:16:27,636 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-10-24 02:16:27,636 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-10-24 02:16:27,636 - INFO - wget check of of http://10.47.255.249 from ctest-pod-38547327 passed
2024-10-24 02:16:32,709 - DEBUG - [Pod ctest-pod-14858385] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-24 02:16:32,709 - DEBUG - [Pod Pod ctest-pod-14858385] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-24 02:16:32,709 - DEBUG - [Pod Pod ctest-pod-14858385] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-24 02:16:32,709 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14858385 passed
2024-10-24 02:16:32,719 - INFO - Updating Network Policy ingress-on-service
2024-10-24 02:16:37,794 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:37,795 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:37,795 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:42,890 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:42,890 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:42,890 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:47,958 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:47,958 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:47,958 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:53,042 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:53,042 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:53,042 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:58,128 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:58,128 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:16:58,128 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:03,203 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:03,203 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:03,203 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:08,293 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:08,293 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:08,293 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:13,368 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:13,369 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:13,369 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:18,453 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:18,453 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:18,453 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:23,543 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:23,543 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:23,543 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
wget: download timed out
2024-10-24 02:17:23,543 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-75459877': 0, 'ctest-pod-68994293': 0}
2024-10-24 02:17:23,624 - DEBUG - [Pod ctest-pod-75540013] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-68994293
2024-10-24 02:17:23,624 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:17:23,624 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-68994293
2024-10-24 02:17:23,707 - DEBUG - [Pod ctest-pod-75540013] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-75459877
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:17:23,708 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:17:23,708 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-75459877
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:17:23,708 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-75459877': 1, 'ctest-pod-68994293': 1}
2024-10-24 02:17:23,784 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-68994293
2024-10-24 02:17:23,784 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:17:23,784 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-68994293
2024-10-24 02:17:23,859 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-68994293
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:17:23,859 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:17:23,860 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: Connecting to 10.110.2.134:80 (10.110.2.134:80)
ctest-pod-68994293
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:17:23,943 - DEBUG - [Pod ctest-pod-39154328] Cmd: wget http://10.110.2.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-75459877
Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:17:23,943 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd wget http://10.110.2.134:80/ -O - -T 5 -t 1 passed
2024-10-24 02:17:23,943 - DEBUG - [Pod Pod ctest-pod-39154328] Cmd output: ctest-pod-75459877
Connecting to 10.110.2.134:80 (10.110.2.134:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-24 02:17:23,943 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-75459877': 1, 'ctest-pod-68994293': 2}
2024-10-24 02:17:26,010 - DEBUG - [Pod ctest-pod-75540013] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.326 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.052 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.052/0.153/0.326 ms
2024-10-24 02:17:26,010 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-75540013 with expectation True passed
2024-10-24 02:17:28,079 - DEBUG - [Pod ctest-pod-38547327] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.572 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.064 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.066 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.064/0.234/0.572 ms
2024-10-24 02:17:28,079 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-38547327 with expectation True passed
2024-10-24 02:17:30,592 - DEBUG - [Pod ctest-pod-39154328] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.756 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.054 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.068 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.054/0.292/0.756 ms
2024-10-24 02:17:30,593 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-39154328 with expectation True passed
2024-10-24 02:17:30,668 - DEBUG - [Pod ctest-pod-75540013] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:17:30,668 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-24 02:17:30,668 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:17:30,668 - INFO - wget check of of http://10.47.255.250 from ctest-pod-75540013 passed
2024-10-24 02:17:30,734 - DEBUG - [Pod ctest-pod-75540013] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:17:30,734 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2024-10-24 02:17:30,734 - DEBUG - [Pod Pod ctest-pod-75540013] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:17:30,735 - INFO - wget check of of http://10.47.255.249 from ctest-pod-75540013 passed
2024-10-24 02:17:35,799 - DEBUG - [Pod ctest-pod-38547327] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-10-24 02:17:35,799 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-10-24 02:17:35,799 - DEBUG - [Pod Pod ctest-pod-38547327] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-10-24 02:17:35,799 - INFO - wget check of of http://10.47.255.249 from ctest-pod-38547327 passed
2024-10-24 02:17:35,878 - DEBUG - [Pod ctest-pod-14858385] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:17:35,878 - DEBUG - [Pod Pod ctest-pod-14858385] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-24 02:17:35,878 - DEBUG - [Pod Pod ctest-pod-14858385] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-24 02:17:35,878 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14858385 passed
2024-10-24 02:17:35,878 - INFO - Deleting Network Policy : ingress-on-service
2024-10-24 02:17:35,879 - INFO - Deleting service : ctest-nginx-svc-65033198
2024-10-24 02:17:36,440 - DEBUG - No XMPP flaps were noticed during the test
2024-10-24 02:17:36,440 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09]
2024-10-24 02:17:36,440 - INFO - --------------------------------------------------------------------------------
2024-10-24 02:17:36,447 - INFO - Deleting pod ctest-new-default-97093252:ctest-pod-75459877
2024-10-24 02:17:36,447 - INFO - Deleting pod ctest-new-default-97093252:ctest-pod-68994293
2024-10-24 02:17:36,448 - INFO - Deleting pod ctest-non-default-78361514:ctest-pod-31252218
2024-10-24 02:17:36,448 - INFO - Deleting pod ctest-non-default-78361514:ctest-pod-34360593
2024-10-24 02:17:36,448 - INFO - Deleting pod ctest-new-default-97093252:ctest-pod-38547327
2024-10-24 02:17:36,449 - INFO - Deleting pod ctest-new-default-97093252:ctest-pod-75540013
2024-10-24 02:17:36,449 - INFO - Deleting pod ctest-non-default-78361514:ctest-pod-39154328
2024-10-24 02:17:36,449 - INFO - Deleting pod ctest-non-default-78361514:ctest-pod-14858385
2024-10-24 02:17:36,535 - WARNING - Pod uuid b7938d08-03ee-4461-92cd-2aed4845617e is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:36,570 - WARNING - Pod uuid f287e80d-4264-45b3-95d2-c802b298c35e is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:36,571 - WARNING - Pod uuid 92ea2338-02b1-4c8c-a50e-32c47c1fd537 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:36,571 - WARNING - Pod uuid 9ed167ea-4e49-46ac-8d62-7a77e878f502 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:36,571 - WARNING - Pod uuid 6b0c0e37-969b-4d4f-8198-92687ca941a7 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:36,571 - WARNING - Pod uuid 526a3041-7ebe-406b-abf7-4a34b5a918b9 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:36,572 - WARNING - Pod uuid 35c9d9f1-688e-4b7a-8002-d84ec5094b6e is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:36,573 - WARNING - Pod uuid 1468d9a1-07fb-4761-b97b-2e1530fd577e is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:41,542 - DEBUG - Pod b7938d08-03ee-4461-92cd-2aed4845617e is not in agent 10.0.0.37 VM list
2024-10-24 02:17:41,548 - DEBUG - VMI a3a98336-91ad-11ef-a76b-0242dd17919e is removed from agent 10.0.0.37
2024-10-24 02:17:41,548 - INFO - Verified that pod ctest-pod-75459877 is removed in agent
2024-10-24 02:17:41,600 - WARNING - Pod uuid 9ed167ea-4e49-46ac-8d62-7a77e878f502 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:41,601 - DEBUG - Pod 92ea2338-02b1-4c8c-a50e-32c47c1fd537 is not in agent 10.0.0.37 VM list
2024-10-24 02:17:41,602 - DEBUG - Pod f287e80d-4264-45b3-95d2-c802b298c35e is not in agent 10.0.0.37 VM list
2024-10-24 02:17:41,606 - DEBUG - Pod 1468d9a1-07fb-4761-b97b-2e1530fd577e is not in agent 10.0.0.37 VM list
2024-10-24 02:17:41,607 - WARNING - Pod uuid 6b0c0e37-969b-4d4f-8198-92687ca941a7 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:41,607 - WARNING - Pod uuid 526a3041-7ebe-406b-abf7-4a34b5a918b9 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:41,608 - WARNING - Pod uuid 35c9d9f1-688e-4b7a-8002-d84ec5094b6e is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:41,617 - DEBUG - VMI a578d1a8-91ad-11ef-a76b-0242dd17919e is removed from agent 10.0.0.37
2024-10-24 02:17:41,617 - INFO - Verified that pod ctest-pod-31252218 is removed in agent
2024-10-24 02:17:41,619 - DEBUG - VMI a63acfa6-91ad-11ef-a76b-0242dd17919e is removed from agent 10.0.0.37
2024-10-24 02:17:41,619 - INFO - Verified that pod ctest-pod-34360593 is removed in agent
2024-10-24 02:17:41,619 - DEBUG - VMI a446d7bc-91ad-11ef-a76b-0242dd17919e is removed from agent 10.0.0.37
2024-10-24 02:17:41,619 - INFO - Verified that pod ctest-pod-68994293 is removed in agent
2024-10-24 02:17:46,607 - WARNING - Pod uuid 9ed167ea-4e49-46ac-8d62-7a77e878f502 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:46,619 - WARNING - Pod uuid 6b0c0e37-969b-4d4f-8198-92687ca941a7 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:46,620 - WARNING - Pod uuid 526a3041-7ebe-406b-abf7-4a34b5a918b9 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:46,621 - WARNING - Pod uuid 35c9d9f1-688e-4b7a-8002-d84ec5094b6e is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:51,614 - WARNING - Pod uuid 9ed167ea-4e49-46ac-8d62-7a77e878f502 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:51,633 - WARNING - Pod uuid 6b0c0e37-969b-4d4f-8198-92687ca941a7 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:51,637 - WARNING - Pod uuid 526a3041-7ebe-406b-abf7-4a34b5a918b9 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:51,638 - WARNING - Pod uuid 35c9d9f1-688e-4b7a-8002-d84ec5094b6e is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:56,621 - WARNING - Pod uuid 9ed167ea-4e49-46ac-8d62-7a77e878f502 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:56,646 - WARNING - Pod uuid 6b0c0e37-969b-4d4f-8198-92687ca941a7 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:56,648 - WARNING - Pod uuid 526a3041-7ebe-406b-abf7-4a34b5a918b9 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:17:56,648 - WARNING - Pod uuid 35c9d9f1-688e-4b7a-8002-d84ec5094b6e is still seen in agent 10.0.0.37 VM list
2024-10-24 02:18:01,628 - WARNING - Pod uuid 9ed167ea-4e49-46ac-8d62-7a77e878f502 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:18:01,664 - WARNING - Pod uuid 6b0c0e37-969b-4d4f-8198-92687ca941a7 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:18:01,664 - WARNING - Pod uuid 35c9d9f1-688e-4b7a-8002-d84ec5094b6e is still seen in agent 10.0.0.37 VM list
2024-10-24 02:18:01,665 - WARNING - Pod uuid 526a3041-7ebe-406b-abf7-4a34b5a918b9 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:18:06,676 - WARNING - Pod uuid 9ed167ea-4e49-46ac-8d62-7a77e878f502 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:18:06,694 - WARNING - Pod uuid 526a3041-7ebe-406b-abf7-4a34b5a918b9 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:18:06,696 - WARNING - Pod uuid 6b0c0e37-969b-4d4f-8198-92687ca941a7 is still seen in agent 10.0.0.37 VM list
2024-10-24 02:18:06,696 - WARNING - Pod uuid 35c9d9f1-688e-4b7a-8002-d84ec5094b6e is still seen in agent 10.0.0.37 VM list
2024-10-24 02:18:11,682 - DEBUG - Pod 9ed167ea-4e49-46ac-8d62-7a77e878f502 is not in agent 10.0.0.37 VM list
2024-10-24 02:18:11,688 - DEBUG - VMI a8bed1fa-91ad-11ef-a76b-0242dd17919e is removed from agent 10.0.0.37
2024-10-24 02:18:11,688 - INFO - Verified that pod ctest-pod-39154328 is removed in agent
2024-10-24 02:18:11,710 - DEBUG - Pod 526a3041-7ebe-406b-abf7-4a34b5a918b9 is not in agent 10.0.0.37 VM list
2024-10-24 02:18:11,712 - DEBUG - Pod 6b0c0e37-969b-4d4f-8198-92687ca941a7 is not in agent 10.0.0.37 VM list
2024-10-24 02:18:11,714 - DEBUG - Pod 35c9d9f1-688e-4b7a-8002-d84ec5094b6e is not in agent 10.0.0.37 VM list
2024-10-24 02:18:11,722 - DEBUG - VMI a6f56c08-91ad-11ef-a76b-0242dd17919e is removed from agent 10.0.0.37
2024-10-24 02:18:11,723 - INFO - Verified that pod ctest-pod-38547327 is removed in agent
2024-10-24 02:18:11,724 - DEBUG - VMI a98e8ab2-91ad-11ef-a76b-0242dd17919e is removed from agent 10.0.0.37
2024-10-24 02:18:11,724 - INFO - Verified that pod ctest-pod-14858385 is removed in agent
2024-10-24 02:18:11,724 - DEBUG - VMI a7eba2da-91ad-11ef-a76b-0242dd17919e is removed from agent 10.0.0.37
2024-10-24 02:18:11,724 - INFO - Verified that pod ctest-pod-75540013 is removed in agent
2024-10-24 02:18:11,724 - INFO - Deleting namespace ctest-non-default-78361514
2024-10-24 02:18:11,734 - DEBUG - Namespace ctest-non-default-78361514 still in k8s
2024-10-24 02:18:13,741 - DEBUG - Namespace ctest-non-default-78361514 still in k8s
2024-10-24 02:18:15,746 - DEBUG - Namespace ctest-non-default-78361514 still in k8s
2024-10-24 02:18:17,751 - DEBUG - Namespace ctest-non-default-78361514 is not in k8s
2024-10-24 02:18:17,751 - DEBUG - No need to check project deletion in contrail-api
2024-10-24 02:18:17,751 - INFO - Deleting namespace ctest-new-default-97093252
2024-10-24 02:18:17,766 - DEBUG - Namespace ctest-new-default-97093252 still in k8s
2024-10-24 02:18:19,771 - DEBUG - Namespace ctest-new-default-97093252 still in k8s
2024-10-24 02:18:21,776 - DEBUG - Namespace ctest-new-default-97093252 still in k8s
2024-10-24 02:18:23,781 - DEBUG - Namespace ctest-new-default-97093252 is not in k8s
2024-10-24 02:18:23,781 - DEBUG - No need to check project deletion in contrail-api