2025-07-24 01:59:40,204 - INFO - Using existing project ['default-domain', 'k8s-default'](39fa1288-e4b3-4896-a02e-e5035d9f9b3e)
2025-07-24 01:59:40,228 - DEBUG - Namespace ctest-new-default-97527452 not present
2025-07-24 01:59:40,236 - INFO - Created namespace ctest-new-default-97527452
2025-07-24 01:59:43,248 - DEBUG - Namespace ctest-non-default-68786095 not present
2025-07-24 01:59:43,255 - INFO - Created namespace ctest-non-default-68786095
2025-07-24 01:59:46,277 - DEBUG - Pod ctest-pod-67604649 not present
2025-07-24 01:59:46,278 - INFO - Creating Pod ctest-pod-67604649
2025-07-24 01:59:46,317 - DEBUG - Pod : ctest-pod-67604649 UUID is 70e2d377-3655-42b4-83fe-bf4bb25175b2
2025-07-24 01:59:46,321 - DEBUG - Pod ctest-pod-25136844 not present
2025-07-24 01:59:46,321 - INFO - Creating Pod ctest-pod-25136844
2025-07-24 01:59:46,344 - DEBUG - Pod : ctest-pod-25136844 UUID is ca966ef2-6ed4-4c1c-8cab-10a62fd38f01
2025-07-24 01:59:46,349 - DEBUG - Pod ctest-pod-40192848 not present
2025-07-24 01:59:46,350 - INFO - Creating Pod ctest-pod-40192848
2025-07-24 01:59:46,386 - DEBUG - Pod : ctest-pod-40192848 UUID is 0068f513-bad5-40cf-ad55-12e66d4954b0
2025-07-24 01:59:46,396 - DEBUG - Pod ctest-pod-37236796 not present
2025-07-24 01:59:46,396 - INFO - Creating Pod ctest-pod-37236796
2025-07-24 01:59:46,422 - DEBUG - Pod : ctest-pod-37236796 UUID is ae11879c-11e1-4e52-881c-4c4037fc2a36
2025-07-24 01:59:46,427 - DEBUG - Pod ctest-pod-05108711 not present
2025-07-24 01:59:46,428 - INFO - Creating Pod ctest-pod-05108711
2025-07-24 01:59:46,461 - DEBUG - Pod : ctest-pod-05108711 UUID is 8e2f6ae6-30a9-40f5-8300-ea21bec43513
2025-07-24 01:59:46,466 - DEBUG - Pod ctest-pod-65781016 not present
2025-07-24 01:59:46,466 - INFO - Creating Pod ctest-pod-65781016
2025-07-24 01:59:46,496 - DEBUG - Pod : ctest-pod-65781016 UUID is a711f3eb-8635-4c15-a932-97367c09f822
2025-07-24 01:59:46,500 - DEBUG - Pod ctest-pod-79906928 not present
2025-07-24 01:59:46,500 - INFO - Creating Pod ctest-pod-79906928
2025-07-24 01:59:46,531 - DEBUG - Pod : ctest-pod-79906928 UUID is 21299012-e3dc-4e31-9eee-865f762bc501
2025-07-24 01:59:46,537 - DEBUG - Pod ctest-pod-18762542 not present
2025-07-24 01:59:46,538 - INFO - Creating Pod ctest-pod-18762542
2025-07-24 01:59:46,561 - DEBUG - Pod : ctest-pod-18762542 UUID is 047af7c7-bd95-4526-a8ac-051427e1f67c
2025-07-24 01:59:46,833 - INFO - Project default-domain:k8s-ctest-new-default-97527452 for Namespace ctest-new-default-97527452 is seen in contrail-api
2025-07-24 01:59:46,833 - DEBUG - Project uuid in Contrail is 1dd300e4-9aaa-4079-b084-4cb4e8030770
2025-07-24 01:59:46,981 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=697f112d-1b9d-4175-8bf4-b4e1a572eb7c
2025-07-24 01:59:46,986 - INFO - Namespace ctest-new-default-97527452 with uuid 697f112d-1b9d-4175-8bf4-b4e1a572eb7c found in kube manager
2025-07-24 01:59:46,986 - INFO - Namespace ctest-new-default-97527452 verification passed
2025-07-24 01:59:47,286 - INFO - Project default-domain:k8s-ctest-non-default-68786095 for Namespace ctest-non-default-68786095 is seen in contrail-api
2025-07-24 01:59:47,286 - DEBUG - Project uuid in Contrail is e4f6c653-c5d2-42a7-a973-eccde8dfe82b
2025-07-24 01:59:47,286 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=9e06f0fd-cdac-449f-91bf-b2c807c55133
2025-07-24 01:59:47,295 - INFO - Namespace ctest-non-default-68786095 with uuid 9e06f0fd-cdac-449f-91bf-b2c807c55133 found in kube manager
2025-07-24 01:59:47,295 - INFO - Namespace ctest-non-default-68786095 verification passed
2025-07-24 01:59:47,303 - DEBUG - Pod ctest-pod-67604649 not in running state.Currently in Pending
2025-07-24 01:59:52,311 - DEBUG - Pod ctest-pod-67604649 not in running state.Currently in Pending
2025-07-24 01:59:57,318 - DEBUG - Pod ctest-pod-67604649 not in running state.Currently in Pending
2025-07-24 02:00:02,325 - INFO - Pod ctest-pod-67604649 is in running state.Got IP 10.47.255.250
2025-07-24 02:00:02,380 - DEBUG - Pod ctest-pod-67604649 has vmi e196fc22-6831-11f0-b92d-0242c26673f1
2025-07-24 02:00:02,380 - INFO - Verified pod ctest-pod-67604649 in contrail-api
2025-07-24 02:00:02,393 - DEBUG - VMI e196fc22-6831-11f0-b92d-0242c26673f1 is active in agent 10.0.0.48
2025-07-24 02:00:02,393 - INFO - Verified Pod ctest-pod-67604649 in agent 10.0.0.48
2025-07-24 02:00:02,393 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=70e2d377-3655-42b4-83fe-bf4bb25175b2
2025-07-24 02:00:02,398 - INFO - Pod ctest-pod-67604649 with uuid 70e2d377-3655-42b4-83fe-bf4bb25175b2 found in kube manager
2025-07-24 02:00:02,399 - INFO - Pod ctest-pod-67604649 verification passed
2025-07-24 02:00:02,405 - INFO - Pod ctest-pod-25136844 is in running state.Got IP 10.47.255.249
2025-07-24 02:00:02,500 - DEBUG - Pod ctest-pod-25136844 has vmi e2524d42-6831-11f0-b92d-0242c26673f1
2025-07-24 02:00:02,500 - INFO - Verified pod ctest-pod-25136844 in contrail-api
2025-07-24 02:00:02,513 - DEBUG - VMI e2524d42-6831-11f0-b92d-0242c26673f1 is active in agent 10.0.0.48
2025-07-24 02:00:02,514 - INFO - Verified Pod ctest-pod-25136844 in agent 10.0.0.48
2025-07-24 02:00:02,515 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=ca966ef2-6ed4-4c1c-8cab-10a62fd38f01
2025-07-24 02:00:02,523 - INFO - Pod ctest-pod-25136844 with uuid ca966ef2-6ed4-4c1c-8cab-10a62fd38f01 found in kube manager
2025-07-24 02:00:02,523 - INFO - Pod ctest-pod-25136844 verification passed
2025-07-24 02:00:02,530 - DEBUG - Pod ctest-pod-40192848 not in running state.Currently in Pending
2025-07-24 02:00:07,536 - INFO - Pod ctest-pod-40192848 is in running state.Got IP 10.47.255.248
2025-07-24 02:00:07,589 - DEBUG - Pod ctest-pod-40192848 has vmi e3633476-6831-11f0-b92d-0242c26673f1
2025-07-24 02:00:07,589 - INFO - Verified pod ctest-pod-40192848 in contrail-api
2025-07-24 02:00:07,603 - DEBUG - VMI e3633476-6831-11f0-b92d-0242c26673f1 is active in agent 10.0.0.48
2025-07-24 02:00:07,603 - INFO - Verified Pod ctest-pod-40192848 in agent 10.0.0.48
2025-07-24 02:00:07,604 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=0068f513-bad5-40cf-ad55-12e66d4954b0
2025-07-24 02:00:07,608 - INFO - Pod ctest-pod-40192848 with uuid 0068f513-bad5-40cf-ad55-12e66d4954b0 found in kube manager
2025-07-24 02:00:07,608 - INFO - Pod ctest-pod-40192848 verification passed
2025-07-24 02:00:07,614 - INFO - Pod ctest-pod-37236796 is in running state.Got IP 10.47.255.247
2025-07-24 02:00:07,710 - DEBUG - Pod ctest-pod-37236796 has vmi e436a068-6831-11f0-b92d-0242c26673f1
2025-07-24 02:00:07,710 - INFO - Verified pod ctest-pod-37236796 in contrail-api
2025-07-24 02:00:07,722 - DEBUG - VMI e436a068-6831-11f0-b92d-0242c26673f1 is active in agent 10.0.0.48
2025-07-24 02:00:07,722 - INFO - Verified Pod ctest-pod-37236796 in agent 10.0.0.48
2025-07-24 02:00:07,723 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=ae11879c-11e1-4e52-881c-4c4037fc2a36
2025-07-24 02:00:07,728 - INFO - Pod ctest-pod-37236796 with uuid ae11879c-11e1-4e52-881c-4c4037fc2a36 found in kube manager
2025-07-24 02:00:07,728 - INFO - Pod ctest-pod-37236796 verification passed
2025-07-24 02:00:07,734 - INFO - Pod ctest-pod-05108711 is in running state.Got IP 10.47.255.246
2025-07-24 02:00:07,830 - DEBUG - Pod ctest-pod-05108711 has vmi e4ff4518-6831-11f0-b92d-0242c26673f1
2025-07-24 02:00:07,830 - INFO - Verified pod ctest-pod-05108711 in contrail-api
2025-07-24 02:00:07,843 - DEBUG - VMI e4ff4518-6831-11f0-b92d-0242c26673f1 is active in agent 10.0.0.48
2025-07-24 02:00:07,843 - INFO - Verified Pod ctest-pod-05108711 in agent 10.0.0.48
2025-07-24 02:00:07,843 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=8e2f6ae6-30a9-40f5-8300-ea21bec43513
2025-07-24 02:00:07,848 - INFO - Pod ctest-pod-05108711 with uuid 8e2f6ae6-30a9-40f5-8300-ea21bec43513 found in kube manager
2025-07-24 02:00:07,848 - INFO - Pod ctest-pod-05108711 verification passed
2025-07-24 02:00:07,855 - DEBUG - Pod ctest-pod-79906928 not in running state.Currently in Pending
2025-07-24 02:00:12,862 - INFO - Pod ctest-pod-79906928 is in running state.Got IP 10.47.255.244
2025-07-24 02:00:12,915 - DEBUG - Pod ctest-pod-79906928 has vmi e6a11c98-6831-11f0-b92d-0242c26673f1
2025-07-24 02:00:12,915 - INFO - Verified pod ctest-pod-79906928 in contrail-api
2025-07-24 02:00:12,927 - DEBUG - VMI e6a11c98-6831-11f0-b92d-0242c26673f1 is active in agent 10.0.0.48
2025-07-24 02:00:12,927 - INFO - Verified Pod ctest-pod-79906928 in agent 10.0.0.48
2025-07-24 02:00:12,927 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=21299012-e3dc-4e31-9eee-865f762bc501
2025-07-24 02:00:12,931 - INFO - Pod ctest-pod-79906928 with uuid 21299012-e3dc-4e31-9eee-865f762bc501 found in kube manager
2025-07-24 02:00:12,931 - INFO - Pod ctest-pod-79906928 verification passed
2025-07-24 02:00:12,937 - INFO - Pod ctest-pod-65781016 is in running state.Got IP 10.47.255.245
2025-07-24 02:00:13,031 - DEBUG - Pod ctest-pod-65781016 has vmi e5c3f926-6831-11f0-b92d-0242c26673f1
2025-07-24 02:00:13,031 - INFO - Verified pod ctest-pod-65781016 in contrail-api
2025-07-24 02:00:13,042 - DEBUG - VMI e5c3f926-6831-11f0-b92d-0242c26673f1 is active in agent 10.0.0.48
2025-07-24 02:00:13,043 - INFO - Verified Pod ctest-pod-65781016 in agent 10.0.0.48
2025-07-24 02:00:13,043 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=a711f3eb-8635-4c15-a932-97367c09f822
2025-07-24 02:00:13,047 - INFO - Pod ctest-pod-65781016 with uuid a711f3eb-8635-4c15-a932-97367c09f822 found in kube manager
2025-07-24 02:00:13,047 - INFO - Pod ctest-pod-65781016 verification passed
2025-07-24 02:00:13,052 - INFO - Pod ctest-pod-18762542 is in running state.Got IP 10.47.255.243
2025-07-24 02:00:13,148 - DEBUG - Pod ctest-pod-18762542 has vmi e76fe938-6831-11f0-b92d-0242c26673f1
2025-07-24 02:00:13,148 - INFO - Verified pod ctest-pod-18762542 in contrail-api
2025-07-24 02:00:13,161 - DEBUG - VMI e76fe938-6831-11f0-b92d-0242c26673f1 is active in agent 10.0.0.48
2025-07-24 02:00:13,161 - INFO - Verified Pod ctest-pod-18762542 in agent 10.0.0.48
2025-07-24 02:00:13,161 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=047af7c7-bd95-4526-a8ac-051427e1f67c
2025-07-24 02:00:13,167 - INFO - Pod ctest-pod-18762542 with uuid 047af7c7-bd95-4526-a8ac-051427e1f67c found in kube manager
2025-07-24 02:00:13,167 - INFO - Pod ctest-pod-18762542 verification passed
2025-07-24 02:00:13,167 - INFO - ================================================================================
2025-07-24 02:00:13,168 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-07-24 02:00:13,168 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-07-24 02:00:13,452 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.0.0.48': '2'}} with
2025-07-24 02:00:13,452 - INFO - Initial checks done. Running the testcase now
2025-07-24 02:00:13,452 - INFO -
2025-07-24 02:00:13,541 - DEBUG - [Pod ctest-pod-67604649] Cmd: echo ctest-pod-67604649 > /usr/share/nginx/html/index.html, Output:
2025-07-24 02:00:13,625 - DEBUG - [Pod ctest-pod-25136844] Cmd: echo ctest-pod-25136844 > /usr/share/nginx/html/index.html, Output:
2025-07-24 02:00:13,698 - DEBUG - [Pod ctest-pod-40192848] Cmd: echo ctest-pod-40192848 > /usr/share/nginx/html/index.html, Output:
2025-07-24 02:00:13,792 - DEBUG - [Pod ctest-pod-37236796] Cmd: echo ctest-pod-37236796 > /usr/share/nginx/html/index.html, Output:
2025-07-24 02:00:13,796 - DEBUG - Service ctest-nginx-svc-24603163 not present
2025-07-24 02:00:13,796 - INFO - Creating service ctest-nginx-svc-24603163
2025-07-24 02:00:14,181 - INFO - Created Service ctest-nginx-svc-24603163
2025-07-24 02:00:14,196 - WARNING - Service UUID 109cacf0-03fb-40c7-be23-dc7c52129cc3 not yet found in contrail-api
2025-07-24 02:00:15,206 - INFO - Validated that Service ctest-nginx-svc-24603163 is seen in contrail-api
2025-07-24 02:00:15,206 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=109cacf0-03fb-40c7-be23-dc7c52129cc3
2025-07-24 02:00:15,211 - INFO - Service ctest-nginx-svc-24603163 with uuid 109cacf0-03fb-40c7-be23-dc7c52129cc3 found in kube manager
2025-07-24 02:00:15,211 - INFO - Service ctest-nginx-svc-24603163 verification passed
2025-07-24 02:00:16,354 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19ctest-pod-67604649
0:00:00 ETA
written to stdout
2025-07-24 02:00:16,355 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:00:16,355 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19ctest-pod-67604649
0:00:00 ETA
written to stdout
2025-07-24 02:00:16,452 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67604649
2025-07-24 02:00:16,452 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:00:16,452 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67604649
2025-07-24 02:00:16,553 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67604649
2025-07-24 02:00:16,553 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:00:16,553 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67604649
2025-07-24 02:00:16,648 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-67604649
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:00:16,648 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:00:16,648 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-67604649
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:00:16,729 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:00:16,729 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:00:16,730 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:00:16,730 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67604649': 4, 'ctest-pod-25136844': 1}
2025-07-24 02:00:16,826 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
ctest-pod-25136844
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:00:16,826 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:00:16,826 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
ctest-pod-25136844
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:00:16,908 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-67604649
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:00:16,908 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:00:16,908 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-67604649
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:00:16,908 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67604649': 1, 'ctest-pod-25136844': 1}
2025-07-24 02:00:16,913 - DEBUG - Network policy ingress-on-service not present
2025-07-24 02:00:16,913 - INFO - Creating Network Policy ingress-on-service
2025-07-24 02:00:16,924 - INFO - Network policy found in k8s
2025-07-24 02:00:16,925 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=621736d7-2687-45be-9bdd-355fd2033194
2025-07-24 02:00:16,930 - INFO - Network Policy ingress-on-service with uuid 621736d7-2687-45be-9bdd-355fd2033194 found in kube manager
2025-07-24 02:00:16,967 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-07-24 02:00:16,967 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-07-24 02:00:16,967 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=621736d7-2687-45be-9bdd-355fd2033194
2025-07-24 02:00:16,999 - WARNING - Network policy with name ingress-on-service not found in agent
2025-07-24 02:00:19,000 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=621736d7-2687-45be-9bdd-355fd2033194
2025-07-24 02:00:19,034 - WARNING - Network policy with name ingress-on-service not found in agent
2025-07-24 02:00:21,035 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=621736d7-2687-45be-9bdd-355fd2033194
2025-07-24 02:00:21,066 - INFO - Network policy with name ingress-on-service found in agent
2025-07-24 02:00:21,066 - INFO - Network Policy ingress-on-service verification passed
2025-07-24 02:00:26,151 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:26,151 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:26,151 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:31,233 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:31,233 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:31,233 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:36,303 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:36,303 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:36,303 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:41,386 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:41,386 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:41,387 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:46,475 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:46,475 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:46,475 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:51,560 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:51,560 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:51,560 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:56,651 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:56,651 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:00:56,651 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:01,738 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:01,738 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:01,738 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:06,817 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:06,817 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:06,817 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:11,906 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:11,906 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:11,906 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:11,906 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67604649': 0, 'ctest-pod-25136844': 0}
2025-07-24 02:01:12,013 - DEBUG - [Pod ctest-pod-65781016] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25136844
2025-07-24 02:01:12,013 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:01:12,013 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25136844
2025-07-24 02:01:12,097 - DEBUG - [Pod ctest-pod-65781016] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:01:12,097 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:01:12,097 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:01:12,168 - DEBUG - [Pod ctest-pod-65781016] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-67604649
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:01:12,168 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:01:12,168 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-67604649
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:01:12,168 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67604649': 1, 'ctest-pod-25136844': 2}
2025-07-24 02:01:17,234 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:17,234 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:17,234 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:22,337 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:22,337 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:22,337 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:27,420 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:27,421 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:27,421 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:32,493 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:32,493 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:32,493 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:37,576 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:37,576 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:37,576 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:42,649 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:42,649 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:42,649 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:47,720 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:47,720 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:47,721 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:52,803 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:52,803 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:52,803 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:57,881 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:57,881 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:01:57,882 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:02,955 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:02,955 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:02,955 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:02,956 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67604649': 0, 'ctest-pod-25136844': 0}
2025-07-24 02:02:05,045 - DEBUG - [Pod ctest-pod-65781016] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.326 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.059 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.059/0.495/1.326 ms
2025-07-24 02:02:05,045 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65781016 with expectation True passed
2025-07-24 02:02:07,116 - DEBUG - [Pod ctest-pod-05108711] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.140 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.431/1.140 ms
2025-07-24 02:02:07,116 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-05108711 with expectation True passed
2025-07-24 02:02:09,198 - DEBUG - [Pod ctest-pod-79906928] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.722 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.056 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.073 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.056/0.617/1.722 ms
2025-07-24 02:02:09,198 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-79906928 with expectation True passed
2025-07-24 02:02:09,280 - DEBUG - [Pod ctest-pod-65781016] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-24 02:02:09,280 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-24 02:02:09,280 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-24 02:02:09,280 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65781016 passed
2025-07-24 02:02:09,360 - DEBUG - [Pod ctest-pod-65781016] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-24 02:02:09,360 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-07-24 02:02:09,361 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-24 02:02:09,361 - INFO - wget check of of http://10.47.255.249 from ctest-pod-65781016 passed
2025-07-24 02:02:14,440 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-24 02:02:14,440 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-24 02:02:14,441 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-24 02:02:14,441 - INFO - wget check of of http://10.47.255.249 from ctest-pod-05108711 passed
2025-07-24 02:02:19,509 - DEBUG - [Pod ctest-pod-18762542] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-24 02:02:19,509 - DEBUG - [Pod Pod ctest-pod-18762542] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-24 02:02:19,509 - DEBUG - [Pod Pod ctest-pod-18762542] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-24 02:02:19,509 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18762542 passed
2025-07-24 02:02:19,520 - INFO - Updating Network Policy ingress-on-service
2025-07-24 02:02:24,596 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:24,596 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:24,596 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:29,664 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:29,664 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:29,664 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:34,750 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:34,751 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:34,751 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:39,823 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:39,823 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:39,823 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:44,891 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:44,892 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:44,892 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:49,960 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:49,960 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:49,960 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:55,030 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:55,031 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:02:55,031 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:03:00,106 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:03:00,106 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:03:00,106 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:03:05,187 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:03:05,187 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:03:05,187 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:03:10,255 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:03:10,255 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:03:10,255 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
wget: download timed out
2025-07-24 02:03:10,256 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67604649': 0, 'ctest-pod-25136844': 0}
2025-07-24 02:03:10,338 - DEBUG - [Pod ctest-pod-65781016] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19ctest-pod-25136844
0:00:00 ETA
written to stdout
2025-07-24 02:03:10,338 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:03:10,338 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19ctest-pod-25136844
0:00:00 ETA
written to stdout
2025-07-24 02:03:10,413 - DEBUG - [Pod ctest-pod-65781016] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67604649
2025-07-24 02:03:10,413 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:03:10,413 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67604649
2025-07-24 02:03:10,413 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67604649': 1, 'ctest-pod-25136844': 1}
2025-07-24 02:03:10,481 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:03:10,481 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:03:10,481 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:03:10,553 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:03:10,553 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:03:10,553 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:03:10,626 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25136844
2025-07-24 02:03:10,626 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:03:10,626 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25136844
2025-07-24 02:03:10,694 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:03:10,694 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:03:10,694 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:03:10,759 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:03:10,759 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:03:10,759 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
ctest-pod-25136844
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-24 02:03:10,827 - DEBUG - [Pod ctest-pod-79906928] Cmd: wget http://10.104.246.254:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67604649
2025-07-24 02:03:10,827 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd wget http://10.104.246.254:80/ -O - -T 5 -t 1 passed
2025-07-24 02:03:10,827 - DEBUG - [Pod Pod ctest-pod-79906928] Cmd output: Connecting to 10.104.246.254:80 (10.104.246.254:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67604649
2025-07-24 02:03:10,827 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67604649': 1, 'ctest-pod-25136844': 5}
2025-07-24 02:03:12,964 - DEBUG - [Pod ctest-pod-65781016] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.565 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.063 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.063/0.234/0.565 ms
2025-07-24 02:03:12,964 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65781016 with expectation True passed
2025-07-24 02:03:15,044 - DEBUG - [Pod ctest-pod-05108711] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.659 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.060 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.060/0.265/0.659 ms
2025-07-24 02:03:15,044 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-05108711 with expectation True passed
2025-07-24 02:03:17,131 - DEBUG - [Pod ctest-pod-79906928] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=4.152 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.052 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.064 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.052/1.422/4.152 ms
2025-07-24 02:03:17,131 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-79906928 with expectation True passed
2025-07-24 02:03:17,240 - DEBUG - [Pod ctest-pod-65781016] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-24 02:03:17,240 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-24 02:03:17,240 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-24 02:03:17,240 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65781016 passed
2025-07-24 02:03:17,342 - DEBUG - [Pod ctest-pod-65781016] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-24 02:03:17,342 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-07-24 02:03:17,342 - DEBUG - [Pod Pod ctest-pod-65781016] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-24 02:03:17,342 - INFO - wget check of of http://10.47.255.249 from ctest-pod-65781016 passed
2025-07-24 02:03:22,459 - DEBUG - [Pod ctest-pod-05108711] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-24 02:03:22,459 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-24 02:03:22,460 - DEBUG - [Pod Pod ctest-pod-05108711] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-24 02:03:22,460 - INFO - wget check of of http://10.47.255.249 from ctest-pod-05108711 passed
2025-07-24 02:03:22,531 - DEBUG - [Pod ctest-pod-18762542] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-24 02:03:22,531 - DEBUG - [Pod Pod ctest-pod-18762542] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-24 02:03:22,531 - DEBUG - [Pod Pod ctest-pod-18762542] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-24 02:03:22,532 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18762542 passed
2025-07-24 02:03:22,532 - INFO - Deleting Network Policy : ingress-on-service
2025-07-24 02:03:22,532 - INFO - Deleting service : ctest-nginx-svc-24603163
2025-07-24 02:03:23,071 - DEBUG - No XMPP flaps were noticed during the test
2025-07-24 02:03:23,071 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10]
2025-07-24 02:03:23,071 - INFO - --------------------------------------------------------------------------------
2025-07-24 02:03:23,076 - INFO - Deleting pod ctest-new-default-97527452:ctest-pod-67604649
2025-07-24 02:03:23,077 - INFO - Deleting pod ctest-new-default-97527452:ctest-pod-25136844
2025-07-24 02:03:23,077 - INFO - Deleting pod ctest-non-default-68786095:ctest-pod-40192848
2025-07-24 02:03:23,078 - INFO - Deleting pod ctest-non-default-68786095:ctest-pod-37236796
2025-07-24 02:03:23,078 - INFO - Deleting pod ctest-new-default-97527452:ctest-pod-05108711
2025-07-24 02:03:23,078 - INFO - Deleting pod ctest-new-default-97527452:ctest-pod-65781016
2025-07-24 02:03:23,079 - INFO - Deleting pod ctest-non-default-68786095:ctest-pod-79906928
2025-07-24 02:03:23,079 - INFO - Deleting pod ctest-non-default-68786095:ctest-pod-18762542
2025-07-24 02:03:23,112 - WARNING - Pod uuid 70e2d377-3655-42b4-83fe-bf4bb25175b2 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:23,226 - WARNING - Pod uuid ae11879c-11e1-4e52-881c-4c4037fc2a36 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:23,226 - WARNING - Pod uuid a711f3eb-8635-4c15-a932-97367c09f822 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:23,228 - WARNING - Pod uuid 0068f513-bad5-40cf-ad55-12e66d4954b0 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:23,229 - WARNING - Pod uuid 21299012-e3dc-4e31-9eee-865f762bc501 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:23,229 - WARNING - Pod uuid ca966ef2-6ed4-4c1c-8cab-10a62fd38f01 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:23,233 - WARNING - Pod uuid 8e2f6ae6-30a9-40f5-8300-ea21bec43513 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:23,235 - WARNING - Pod uuid 047af7c7-bd95-4526-a8ac-051427e1f67c is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:28,120 - DEBUG - Pod 70e2d377-3655-42b4-83fe-bf4bb25175b2 is not in agent 10.0.0.48 VM list
2025-07-24 02:03:28,126 - DEBUG - VMI e196fc22-6831-11f0-b92d-0242c26673f1 is removed from agent 10.0.0.48
2025-07-24 02:03:28,126 - INFO - Verified that pod ctest-pod-67604649 is removed in agent
2025-07-24 02:03:28,254 - WARNING - Pod uuid 21299012-e3dc-4e31-9eee-865f762bc501 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:28,254 - WARNING - Pod uuid a711f3eb-8635-4c15-a932-97367c09f822 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:28,255 - DEBUG - Pod ae11879c-11e1-4e52-881c-4c4037fc2a36 is not in agent 10.0.0.48 VM list
2025-07-24 02:03:28,259 - WARNING - Pod uuid 047af7c7-bd95-4526-a8ac-051427e1f67c is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:28,259 - WARNING - Pod uuid 8e2f6ae6-30a9-40f5-8300-ea21bec43513 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:28,260 - DEBUG - Pod 0068f513-bad5-40cf-ad55-12e66d4954b0 is not in agent 10.0.0.48 VM list
2025-07-24 02:03:28,261 - DEBUG - Pod ca966ef2-6ed4-4c1c-8cab-10a62fd38f01 is not in agent 10.0.0.48 VM list
2025-07-24 02:03:28,274 - DEBUG - VMI e436a068-6831-11f0-b92d-0242c26673f1 is removed from agent 10.0.0.48
2025-07-24 02:03:28,274 - INFO - Verified that pod ctest-pod-37236796 is removed in agent
2025-07-24 02:03:28,276 - DEBUG - VMI e3633476-6831-11f0-b92d-0242c26673f1 is removed from agent 10.0.0.48
2025-07-24 02:03:28,276 - INFO - Verified that pod ctest-pod-40192848 is removed in agent
2025-07-24 02:03:28,276 - DEBUG - VMI e2524d42-6831-11f0-b92d-0242c26673f1 is removed from agent 10.0.0.48
2025-07-24 02:03:28,276 - INFO - Verified that pod ctest-pod-25136844 is removed in agent
2025-07-24 02:03:33,271 - WARNING - Pod uuid a711f3eb-8635-4c15-a932-97367c09f822 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:33,272 - WARNING - Pod uuid 8e2f6ae6-30a9-40f5-8300-ea21bec43513 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:33,273 - WARNING - Pod uuid 047af7c7-bd95-4526-a8ac-051427e1f67c is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:33,273 - WARNING - Pod uuid 21299012-e3dc-4e31-9eee-865f762bc501 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:38,290 - WARNING - Pod uuid a711f3eb-8635-4c15-a932-97367c09f822 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:38,293 - WARNING - Pod uuid 21299012-e3dc-4e31-9eee-865f762bc501 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:38,293 - WARNING - Pod uuid 047af7c7-bd95-4526-a8ac-051427e1f67c is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:38,293 - WARNING - Pod uuid 8e2f6ae6-30a9-40f5-8300-ea21bec43513 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:43,299 - WARNING - Pod uuid a711f3eb-8635-4c15-a932-97367c09f822 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:43,306 - WARNING - Pod uuid 21299012-e3dc-4e31-9eee-865f762bc501 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:43,308 - WARNING - Pod uuid 047af7c7-bd95-4526-a8ac-051427e1f67c is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:43,308 - WARNING - Pod uuid 8e2f6ae6-30a9-40f5-8300-ea21bec43513 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:48,305 - WARNING - Pod uuid a711f3eb-8635-4c15-a932-97367c09f822 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:48,321 - WARNING - Pod uuid 21299012-e3dc-4e31-9eee-865f762bc501 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:48,321 - WARNING - Pod uuid 8e2f6ae6-30a9-40f5-8300-ea21bec43513 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:48,322 - WARNING - Pod uuid 047af7c7-bd95-4526-a8ac-051427e1f67c is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:53,313 - WARNING - Pod uuid a711f3eb-8635-4c15-a932-97367c09f822 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:53,338 - WARNING - Pod uuid 047af7c7-bd95-4526-a8ac-051427e1f67c is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:53,339 - WARNING - Pod uuid 8e2f6ae6-30a9-40f5-8300-ea21bec43513 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:53,339 - WARNING - Pod uuid 21299012-e3dc-4e31-9eee-865f762bc501 is still seen in agent 10.0.0.48 VM list
2025-07-24 02:03:58,319 - DEBUG - Pod a711f3eb-8635-4c15-a932-97367c09f822 is not in agent 10.0.0.48 VM list
2025-07-24 02:03:58,324 - DEBUG - VMI e5c3f926-6831-11f0-b92d-0242c26673f1 is removed from agent 10.0.0.48
2025-07-24 02:03:58,324 - INFO - Verified that pod ctest-pod-65781016 is removed in agent
2025-07-24 02:03:58,354 - DEBUG - Pod 047af7c7-bd95-4526-a8ac-051427e1f67c is not in agent 10.0.0.48 VM list
2025-07-24 02:03:58,357 - DEBUG - Pod 21299012-e3dc-4e31-9eee-865f762bc501 is not in agent 10.0.0.48 VM list
2025-07-24 02:03:58,358 - DEBUG - Pod 8e2f6ae6-30a9-40f5-8300-ea21bec43513 is not in agent 10.0.0.48 VM list
2025-07-24 02:03:58,370 - DEBUG - VMI e76fe938-6831-11f0-b92d-0242c26673f1 is removed from agent 10.0.0.48
2025-07-24 02:03:58,370 - INFO - Verified that pod ctest-pod-18762542 is removed in agent
2025-07-24 02:03:58,371 - DEBUG - VMI e6a11c98-6831-11f0-b92d-0242c26673f1 is removed from agent 10.0.0.48
2025-07-24 02:03:58,371 - INFO - Verified that pod ctest-pod-79906928 is removed in agent
2025-07-24 02:03:58,372 - DEBUG - VMI e4ff4518-6831-11f0-b92d-0242c26673f1 is removed from agent 10.0.0.48
2025-07-24 02:03:58,372 - INFO - Verified that pod ctest-pod-05108711 is removed in agent
2025-07-24 02:03:58,372 - INFO - Deleting namespace ctest-non-default-68786095
2025-07-24 02:03:58,381 - DEBUG - Namespace ctest-non-default-68786095 still in k8s
2025-07-24 02:04:00,385 - DEBUG - Namespace ctest-non-default-68786095 still in k8s
2025-07-24 02:04:02,391 - DEBUG - Namespace ctest-non-default-68786095 still in k8s
2025-07-24 02:04:04,395 - DEBUG - Namespace ctest-non-default-68786095 is not in k8s
2025-07-24 02:04:04,396 - DEBUG - No need to check project deletion in contrail-api
2025-07-24 02:04:04,396 - INFO - Deleting namespace ctest-new-default-97527452
2025-07-24 02:04:04,406 - DEBUG - Namespace ctest-new-default-97527452 still in k8s
2025-07-24 02:04:06,410 - DEBUG - Namespace ctest-new-default-97527452 still in k8s
2025-07-24 02:04:08,417 - DEBUG - Namespace ctest-new-default-97527452 still in k8s
2025-07-24 02:04:10,421 - DEBUG - Namespace ctest-new-default-97527452 is not in k8s
2025-07-24 02:04:10,421 - DEBUG - No need to check project deletion in contrail-api