2026-02-12 03:49:12,500 - INFO - Using existing project ['default-domain', 'k8s-default'](684f09ef-e0a6-447c-9afe-32de4f0d16ed)
2026-02-12 03:49:12,516 - DEBUG - Namespace ctest-new-default-94288548 not present
2026-02-12 03:49:12,523 - INFO - Created namespace ctest-new-default-94288548
2026-02-12 03:49:15,527 - DEBUG - Namespace ctest-non-default-05833981 not present
2026-02-12 03:49:15,536 - INFO - Created namespace ctest-non-default-05833981
2026-02-12 03:49:18,565 - DEBUG - Pod ctest-pod-30783544 not present
2026-02-12 03:49:18,566 - INFO - Creating Pod ctest-pod-30783544
2026-02-12 03:49:18,613 - DEBUG - Pod : ctest-pod-30783544 UUID is 45676014-602d-41c9-95d4-d63cee17f7f1
2026-02-12 03:49:18,629 - DEBUG - Pod ctest-pod-77980247 not present
2026-02-12 03:49:18,630 - INFO - Creating Pod ctest-pod-77980247
2026-02-12 03:49:18,659 - DEBUG - Pod : ctest-pod-77980247 UUID is 36b176de-5397-45f3-9ee2-101911da43bc
2026-02-12 03:49:18,692 - DEBUG - Pod ctest-pod-88304533 not present
2026-02-12 03:49:18,693 - INFO - Creating Pod ctest-pod-88304533
2026-02-12 03:49:18,718 - DEBUG - Pod : ctest-pod-88304533 UUID is d6dea3a5-837d-47f8-bfa2-2ea4c6dc08ed
2026-02-12 03:49:18,720 - DEBUG - Pod ctest-pod-51393113 not present
2026-02-12 03:49:18,721 - INFO - Creating Pod ctest-pod-51393113
2026-02-12 03:49:18,741 - DEBUG - Pod : ctest-pod-51393113 UUID is dc6163ac-f157-4da8-aa85-b3b9d9293db4
2026-02-12 03:49:18,747 - DEBUG - Pod ctest-pod-61473751 not present
2026-02-12 03:49:18,748 - INFO - Creating Pod ctest-pod-61473751
2026-02-12 03:49:18,769 - DEBUG - Pod : ctest-pod-61473751 UUID is d5618a52-e184-42ee-9d49-7a7e53fbfe73
2026-02-12 03:49:18,771 - DEBUG - Pod ctest-pod-76332043 not present
2026-02-12 03:49:18,771 - INFO - Creating Pod ctest-pod-76332043
2026-02-12 03:49:18,794 - DEBUG - Pod : ctest-pod-76332043 UUID is 5b5859c2-e638-4ef7-904c-6291025f13a8
2026-02-12 03:49:18,799 - DEBUG - Pod ctest-pod-66092433 not present
2026-02-12 03:49:18,799 - INFO - Creating Pod ctest-pod-66092433
2026-02-12 03:49:18,820 - DEBUG - Pod : ctest-pod-66092433 UUID is 1f2abd4d-b979-4b48-a3db-7907a611f0a4
2026-02-12 03:49:18,822 - DEBUG - Pod ctest-pod-65933478 not present
2026-02-12 03:49:18,822 - INFO - Creating Pod ctest-pod-65933478
2026-02-12 03:49:18,858 - DEBUG - Pod : ctest-pod-65933478 UUID is ac1475ff-933a-4ecc-816d-1510ceff1e9a
2026-02-12 03:49:19,033 - INFO - Project default-domain:k8s-ctest-new-default-94288548 for Namespace ctest-new-default-94288548 is seen in contrail-api
2026-02-12 03:49:19,033 - DEBUG - Project uuid in Contrail is 3e0e1151-53b7-4db4-9fa4-48ef9408797d
2026-02-12 03:49:19,184 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_NamespaceDatabaseList?namespace_uuid=e4dadd3d-c892-4f0b-97e7-29b726dfc95f
2026-02-12 03:49:19,187 - INFO - Namespace ctest-new-default-94288548 with uuid e4dadd3d-c892-4f0b-97e7-29b726dfc95f found in kube manager
2026-02-12 03:49:19,187 - INFO - Namespace ctest-new-default-94288548 verification passed
2026-02-12 03:49:19,428 - INFO - Project default-domain:k8s-ctest-non-default-05833981 for Namespace ctest-non-default-05833981 is seen in contrail-api
2026-02-12 03:49:19,428 - DEBUG - Project uuid in Contrail is 3df15c96-be64-4da6-8ccc-6ff93d280c82
2026-02-12 03:49:19,428 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_NamespaceDatabaseList?namespace_uuid=55019d2e-74e5-4db3-861b-9ca230b62cb0
2026-02-12 03:49:19,432 - INFO - Namespace ctest-non-default-05833981 with uuid 55019d2e-74e5-4db3-861b-9ca230b62cb0 found in kube manager
2026-02-12 03:49:19,432 - INFO - Namespace ctest-non-default-05833981 verification passed
2026-02-12 03:49:19,438 - DEBUG - Pod ctest-pod-30783544 not in running state.Currently in Pending
2026-02-12 03:49:24,447 - DEBUG - Pod ctest-pod-30783544 not in running state.Currently in Pending
2026-02-12 03:49:29,453 - DEBUG - Pod ctest-pod-30783544 not in running state.Currently in Pending
2026-02-12 03:49:34,461 - INFO - Pod ctest-pod-30783544 is in running state.Got IP 10.47.255.251
2026-02-12 03:49:34,473 - DEBUG - Pod ctest-pod-30783544 has vmi cfc24e78-07c5-11f1-be85-fa163e899621
2026-02-12 03:49:34,474 - INFO - Verified pod ctest-pod-30783544 in contrail-api
2026-02-12 03:49:34,487 - DEBUG - VMI cfc24e78-07c5-11f1-be85-fa163e899621 is active in agent 10.0.0.50
2026-02-12 03:49:34,487 - INFO - Verified Pod ctest-pod-30783544 in agent 10.0.0.50
2026-02-12 03:49:34,487 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_VirtualMachineDatabaseList?x=45676014-602d-41c9-95d4-d63cee17f7f1
2026-02-12 03:49:34,491 - INFO - Pod ctest-pod-30783544 with uuid 45676014-602d-41c9-95d4-d63cee17f7f1 found in kube manager
2026-02-12 03:49:34,491 - INFO - Pod ctest-pod-30783544 verification passed
2026-02-12 03:49:34,499 - INFO - Pod ctest-pod-77980247 is in running state.Got IP 10.47.255.250
2026-02-12 03:49:34,559 - DEBUG - Pod ctest-pod-77980247 has vmi d03c1640-07c5-11f1-be85-fa163e899621
2026-02-12 03:49:34,560 - INFO - Verified pod ctest-pod-77980247 in contrail-api
2026-02-12 03:49:34,571 - DEBUG - VMI d03c1640-07c5-11f1-be85-fa163e899621 is active in agent 10.0.0.50
2026-02-12 03:49:34,571 - INFO - Verified Pod ctest-pod-77980247 in agent 10.0.0.50
2026-02-12 03:49:34,571 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_VirtualMachineDatabaseList?x=36b176de-5397-45f3-9ee2-101911da43bc
2026-02-12 03:49:34,575 - INFO - Pod ctest-pod-77980247 with uuid 36b176de-5397-45f3-9ee2-101911da43bc found in kube manager
2026-02-12 03:49:34,575 - INFO - Pod ctest-pod-77980247 verification passed
2026-02-12 03:49:34,582 - INFO - Pod ctest-pod-88304533 is in running state.Got IP 10.47.255.249
2026-02-12 03:49:34,595 - DEBUG - Pod ctest-pod-88304533 has vmi d0ca5cde-07c5-11f1-be85-fa163e899621
2026-02-12 03:49:34,595 - INFO - Verified pod ctest-pod-88304533 in contrail-api
2026-02-12 03:49:34,608 - DEBUG - VMI d0ca5cde-07c5-11f1-be85-fa163e899621 is active in agent 10.0.0.50
2026-02-12 03:49:34,608 - INFO - Verified Pod ctest-pod-88304533 in agent 10.0.0.50
2026-02-12 03:49:34,608 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_VirtualMachineDatabaseList?x=d6dea3a5-837d-47f8-bfa2-2ea4c6dc08ed
2026-02-12 03:49:34,613 - INFO - Pod ctest-pod-88304533 with uuid d6dea3a5-837d-47f8-bfa2-2ea4c6dc08ed found in kube manager
2026-02-12 03:49:34,613 - INFO - Pod ctest-pod-88304533 verification passed
2026-02-12 03:49:34,623 - INFO - Pod ctest-pod-51393113 is in running state.Got IP 10.47.255.248
2026-02-12 03:49:34,684 - DEBUG - Pod ctest-pod-51393113 has vmi d1394f90-07c5-11f1-be85-fa163e899621
2026-02-12 03:49:34,684 - INFO - Verified pod ctest-pod-51393113 in contrail-api
2026-02-12 03:49:34,695 - DEBUG - VMI d1394f90-07c5-11f1-be85-fa163e899621 is active in agent 10.0.0.50
2026-02-12 03:49:34,695 - INFO - Verified Pod ctest-pod-51393113 in agent 10.0.0.50
2026-02-12 03:49:34,696 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_VirtualMachineDatabaseList?x=dc6163ac-f157-4da8-aa85-b3b9d9293db4
2026-02-12 03:49:34,701 - INFO - Pod ctest-pod-51393113 with uuid dc6163ac-f157-4da8-aa85-b3b9d9293db4 found in kube manager
2026-02-12 03:49:34,701 - INFO - Pod ctest-pod-51393113 verification passed
2026-02-12 03:49:34,711 - INFO - Pod ctest-pod-61473751 is in running state.Got IP 10.47.255.247
2026-02-12 03:49:34,722 - DEBUG - Pod ctest-pod-61473751 has vmi d1ae731a-07c5-11f1-be85-fa163e899621
2026-02-12 03:49:34,723 - INFO - Verified pod ctest-pod-61473751 in contrail-api
2026-02-12 03:49:34,734 - DEBUG - VMI d1ae731a-07c5-11f1-be85-fa163e899621 is active in agent 10.0.0.50
2026-02-12 03:49:34,734 - INFO - Verified Pod ctest-pod-61473751 in agent 10.0.0.50
2026-02-12 03:49:34,734 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_VirtualMachineDatabaseList?x=d5618a52-e184-42ee-9d49-7a7e53fbfe73
2026-02-12 03:49:34,738 - INFO - Pod ctest-pod-61473751 with uuid d5618a52-e184-42ee-9d49-7a7e53fbfe73 found in kube manager
2026-02-12 03:49:34,738 - INFO - Pod ctest-pod-61473751 verification passed
2026-02-12 03:49:34,743 - DEBUG - Pod ctest-pod-66092433 not in running state.Currently in Pending
2026-02-12 03:49:39,751 - INFO - Pod ctest-pod-66092433 is in running state.Got IP 10.47.255.245
2026-02-12 03:49:39,803 - DEBUG - Pod ctest-pod-66092433 has vmi d28a3b34-07c5-11f1-be85-fa163e899621
2026-02-12 03:49:39,804 - INFO - Verified pod ctest-pod-66092433 in contrail-api
2026-02-12 03:49:39,816 - DEBUG - VMI d28a3b34-07c5-11f1-be85-fa163e899621 is active in agent 10.0.0.50
2026-02-12 03:49:39,816 - INFO - Verified Pod ctest-pod-66092433 in agent 10.0.0.50
2026-02-12 03:49:39,816 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_VirtualMachineDatabaseList?x=1f2abd4d-b979-4b48-a3db-7907a611f0a4
2026-02-12 03:49:39,820 - INFO - Pod ctest-pod-66092433 with uuid 1f2abd4d-b979-4b48-a3db-7907a611f0a4 found in kube manager
2026-02-12 03:49:39,820 - INFO - Pod ctest-pod-66092433 verification passed
2026-02-12 03:49:39,827 - INFO - Pod ctest-pod-76332043 is in running state.Got IP 10.47.255.246
2026-02-12 03:49:39,844 - DEBUG - Pod ctest-pod-76332043 has vmi d212d0a8-07c5-11f1-be85-fa163e899621
2026-02-12 03:49:39,844 - INFO - Verified pod ctest-pod-76332043 in contrail-api
2026-02-12 03:49:39,858 - DEBUG - VMI d212d0a8-07c5-11f1-be85-fa163e899621 is active in agent 10.0.0.50
2026-02-12 03:49:39,858 - INFO - Verified Pod ctest-pod-76332043 in agent 10.0.0.50
2026-02-12 03:49:39,858 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_VirtualMachineDatabaseList?x=5b5859c2-e638-4ef7-904c-6291025f13a8
2026-02-12 03:49:39,862 - INFO - Pod ctest-pod-76332043 with uuid 5b5859c2-e638-4ef7-904c-6291025f13a8 found in kube manager
2026-02-12 03:49:39,862 - INFO - Pod ctest-pod-76332043 verification passed
2026-02-12 03:49:39,868 - INFO - Pod ctest-pod-65933478 is in running state.Got IP 10.47.255.244
2026-02-12 03:49:39,922 - DEBUG - Pod ctest-pod-65933478 has vmi d2ef9556-07c5-11f1-be85-fa163e899621
2026-02-12 03:49:39,922 - INFO - Verified pod ctest-pod-65933478 in contrail-api
2026-02-12 03:49:39,935 - DEBUG - VMI d2ef9556-07c5-11f1-be85-fa163e899621 is active in agent 10.0.0.50
2026-02-12 03:49:39,935 - INFO - Verified Pod ctest-pod-65933478 in agent 10.0.0.50
2026-02-12 03:49:39,935 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_VirtualMachineDatabaseList?x=ac1475ff-933a-4ecc-816d-1510ceff1e9a
2026-02-12 03:49:39,938 - INFO - Pod ctest-pod-65933478 with uuid ac1475ff-933a-4ecc-816d-1510ceff1e9a found in kube manager
2026-02-12 03:49:39,938 - INFO - Pod ctest-pod-65933478 verification passed
2026-02-12 03:49:39,938 - INFO - ================================================================================
2026-02-12 03:49:39,938 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2026-02-12 03:49:39,938 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2026-02-12 03:49:40,184 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.0.0.240': '0'}} with
2026-02-12 03:49:40,184 - INFO - Initial checks done. Running the testcase now
2026-02-12 03:49:40,184 - INFO -
2026-02-12 03:49:40,245 - DEBUG - [Pod ctest-pod-30783544] Cmd: echo ctest-pod-30783544 > /usr/share/nginx/html/index.html, Output:
2026-02-12 03:49:40,307 - DEBUG - [Pod ctest-pod-77980247] Cmd: echo ctest-pod-77980247 > /usr/share/nginx/html/index.html, Output:
2026-02-12 03:49:40,362 - DEBUG - [Pod ctest-pod-88304533] Cmd: echo ctest-pod-88304533 > /usr/share/nginx/html/index.html, Output:
2026-02-12 03:49:40,417 - DEBUG - [Pod ctest-pod-51393113] Cmd: echo ctest-pod-51393113 > /usr/share/nginx/html/index.html, Output:
2026-02-12 03:49:40,420 - DEBUG - Service ctest-nginx-svc-49682764 not present
2026-02-12 03:49:40,420 - INFO - Creating service ctest-nginx-svc-49682764
2026-02-12 03:49:40,440 - INFO - Created Service ctest-nginx-svc-49682764
2026-02-12 03:49:40,452 - WARNING - Service UUID eab1a256-b6bb-480f-ba71-f9f0ad5a1a6c not yet found in contrail-api
2026-02-12 03:49:41,459 - INFO - Validated that Service ctest-nginx-svc-49682764 is seen in contrail-api
2026-02-12 03:49:41,459 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_LoadbalancerDatabaseList?x=eab1a256-b6bb-480f-ba71-f9f0ad5a1a6c
2026-02-12 03:49:41,465 - INFO - Service ctest-nginx-svc-49682764 with uuid eab1a256-b6bb-480f-ba71-f9f0ad5a1a6c found in kube manager
2026-02-12 03:49:41,466 - INFO - Service ctest-nginx-svc-49682764 verification passed
2026-02-12 03:49:42,542 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30783544
2026-02-12 03:49:42,542 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:49:42,543 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30783544
2026-02-12 03:49:42,588 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: ctest-pod-30783544
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:49:42,588 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:49:42,588 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: ctest-pod-30783544
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:49:42,662 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: ctest-pod-77980247
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:49:42,662 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:49:42,662 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: ctest-pod-77980247
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:49:42,662 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30783544': 2, 'ctest-pod-77980247': 1}
2026-02-12 03:49:42,727 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: ctest-pod-77980247
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:49:42,727 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:49:42,727 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: ctest-pod-77980247
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:49:42,780 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: ctest-pod-77980247
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:49:42,780 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:49:42,780 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: ctest-pod-77980247
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:49:42,839 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: ctest-pod-30783544
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:49:42,839 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:49:42,839 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: ctest-pod-30783544
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:49:42,839 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30783544': 1, 'ctest-pod-77980247': 2}
2026-02-12 03:49:42,842 - DEBUG - Network policy ingress-on-service not present
2026-02-12 03:49:42,843 - INFO - Creating Network Policy ingress-on-service
2026-02-12 03:49:42,859 - INFO - Network policy found in k8s
2026-02-12 03:49:42,859 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6225f7e7-8d27-4ab2-aaef-c90a05ce7084
2026-02-12 03:49:42,866 - INFO - Network Policy ingress-on-service with uuid 6225f7e7-8d27-4ab2-aaef-c90a05ce7084 found in kube manager
2026-02-12 03:49:42,891 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2026-02-12 03:49:42,891 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2026-02-12 03:49:42,891 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6225f7e7-8d27-4ab2-aaef-c90a05ce7084
2026-02-12 03:49:42,915 - WARNING - Network policy with name ingress-on-service not found in agent
2026-02-12 03:49:44,916 - DEBUG - Requesting: http://10.0.0.240:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6225f7e7-8d27-4ab2-aaef-c90a05ce7084
2026-02-12 03:49:44,943 - INFO - Network policy with name ingress-on-service found in agent
2026-02-12 03:49:44,943 - INFO - Network Policy ingress-on-service verification passed
2026-02-12 03:49:50,000 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:49:50,000 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:49:50,000 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:49:55,058 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:49:55,058 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:49:55,058 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:00,110 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:00,110 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:00,110 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:05,162 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:05,162 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:05,162 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:10,209 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:10,209 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:10,209 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:15,262 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:15,262 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:15,262 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:20,317 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:20,317 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:20,317 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:25,370 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:25,370 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:25,370 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:30,418 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:30,418 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:30,418 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:31,559 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2026-02-12 03:50:41,613 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:41,613 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:41,613 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:41,613 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-30783544': 0, 'ctest-pod-77980247': 0}
2026-02-12 03:50:41,666 - DEBUG - [Pod ctest-pod-76332043] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: ctest-pod-77980247
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:50:41,666 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:50:41,666 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd output: ctest-pod-77980247
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:50:41,720 - DEBUG - [Pod ctest-pod-76332043] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: ctest-pod-30783544
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:50:41,720 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:50:41,720 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd output: ctest-pod-30783544
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:50:41,720 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30783544': 1, 'ctest-pod-77980247': 1}
2026-02-12 03:50:46,773 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:46,773 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:46,773 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:51,826 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:51,826 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:51,826 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:56,882 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:50:56,882 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:50:56,882 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:01,933 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:01,934 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:51:01,934 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:06,990 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:06,990 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:51:06,990 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:12,044 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:12,044 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:51:12,044 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:17,091 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:17,091 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:51:17,092 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:22,151 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:22,151 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:51:22,151 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:27,215 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:27,215 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:51:27,215 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:32,270 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:32,270 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:51:32,270 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:32,270 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-30783544': 0, 'ctest-pod-77980247': 0}
2026-02-12 03:51:34,323 - DEBUG - [Pod ctest-pod-76332043] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.690 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.204 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.324/0.690 ms
2026-02-12 03:51:34,323 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-76332043 with expectation True passed
2026-02-12 03:51:36,371 - DEBUG - [Pod ctest-pod-61473751] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.787 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.319/0.787 ms
2026-02-12 03:51:36,371 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-61473751 with expectation True passed
2026-02-12 03:51:38,425 - DEBUG - [Pod ctest-pod-66092433] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.486 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.215/0.486 ms
2026-02-12 03:51:38,425 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-66092433 with expectation True passed
2026-02-12 03:51:38,480 - DEBUG - [Pod ctest-pod-76332043] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-30783544
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:51:38,480 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-02-12 03:51:38,480 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd output: ctest-pod-30783544
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:51:38,480 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76332043 passed
2026-02-12 03:51:38,530 - DEBUG - [Pod ctest-pod-76332043] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-77980247
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:51:38,530 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-02-12 03:51:38,530 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd output: ctest-pod-77980247
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:51:38,530 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76332043 passed
2026-02-12 03:51:43,578 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-02-12 03:51:43,578 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-02-12 03:51:43,578 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-02-12 03:51:43,578 - INFO - wget check of of http://10.47.255.250 from ctest-pod-61473751 passed
2026-02-12 03:51:48,640 - DEBUG - [Pod ctest-pod-65933478] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-02-12 03:51:48,640 - DEBUG - [Pod Pod ctest-pod-65933478] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 failed.
2026-02-12 03:51:48,640 - DEBUG - [Pod Pod ctest-pod-65933478] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-02-12 03:51:48,640 - INFO - wget check of of http://10.47.255.251 from ctest-pod-65933478 passed
2026-02-12 03:51:48,649 - INFO - Updating Network Policy ingress-on-service
2026-02-12 03:51:53,734 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:53,734 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:51:53,734 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:58,788 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:51:58,788 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:51:58,788 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:03,853 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:03,853 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:52:03,853 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:08,903 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:08,904 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:52:08,904 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:13,953 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:13,953 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:52:13,954 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:19,014 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:19,014 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:52:19,014 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:24,071 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:24,071 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:52:24,071 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:29,118 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:29,118 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:52:29,118 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:34,170 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:34,170 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:52:34,170 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:39,217 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:39,217 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 failed.
2026-02-12 03:52:39,218 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
wget: download timed out
2026-02-12 03:52:39,218 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-30783544': 0, 'ctest-pod-77980247': 0}
2026-02-12 03:52:39,267 - DEBUG - [Pod ctest-pod-76332043] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: ctest-pod-30783544
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:39,267 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:52:39,267 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd output: ctest-pod-30783544
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:39,301 - DEBUG - [Pod ctest-pod-76332043] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: ctest-pod-77980247
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:39,301 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:52:39,301 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd output: ctest-pod-77980247
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:39,301 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30783544': 1, 'ctest-pod-77980247': 1}
2026-02-12 03:52:39,352 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: ctest-pod-30783544
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:39,352 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:52:39,352 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: ctest-pod-30783544
Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:39,403 - DEBUG - [Pod ctest-pod-66092433] Cmd: wget http://10.109.239.241:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-77980247
2026-02-12 03:52:39,403 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd wget http://10.109.239.241:80/ -O - -T 5 -t 1 passed
2026-02-12 03:52:39,403 - DEBUG - [Pod Pod ctest-pod-66092433] Cmd output: Connecting to 10.109.239.241:80 (10.109.239.241:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-77980247
2026-02-12 03:52:39,403 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30783544': 1, 'ctest-pod-77980247': 1}
2026-02-12 03:52:41,446 - DEBUG - [Pod ctest-pod-76332043] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.655 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.093 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.274/0.655 ms
2026-02-12 03:52:41,446 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-76332043 with expectation True passed
2026-02-12 03:52:43,491 - DEBUG - [Pod ctest-pod-61473751] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.176 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.442/1.176 ms
2026-02-12 03:52:43,491 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-61473751 with expectation True passed
2026-02-12 03:52:45,547 - DEBUG - [Pod ctest-pod-66092433] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.490 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.214/0.490 ms
2026-02-12 03:52:45,547 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-66092433 with expectation True passed
2026-02-12 03:52:45,608 - DEBUG - [Pod ctest-pod-76332043] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-30783544
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:45,608 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-02-12 03:52:45,608 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd output: ctest-pod-30783544
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:45,608 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76332043 passed
2026-02-12 03:52:45,656 - DEBUG - [Pod ctest-pod-76332043] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-77980247
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:45,656 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-02-12 03:52:45,656 - DEBUG - [Pod Pod ctest-pod-76332043] Cmd output: ctest-pod-77980247
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:45,656 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76332043 passed
2026-02-12 03:52:50,706 - DEBUG - [Pod ctest-pod-61473751] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-02-12 03:52:50,706 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-02-12 03:52:50,706 - DEBUG - [Pod Pod ctest-pod-61473751] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-02-12 03:52:50,706 - INFO - wget check of of http://10.47.255.250 from ctest-pod-61473751 passed
2026-02-12 03:52:50,761 - DEBUG - [Pod ctest-pod-65933478] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-30783544
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:50,762 - DEBUG - [Pod Pod ctest-pod-65933478] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-02-12 03:52:50,762 - DEBUG - [Pod Pod ctest-pod-65933478] Cmd output: ctest-pod-30783544
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-02-12 03:52:50,762 - INFO - wget check of of http://10.47.255.251 from ctest-pod-65933478 passed
2026-02-12 03:52:50,762 - INFO - Deleting Network Policy : ingress-on-service
2026-02-12 03:52:50,763 - INFO - Deleting service : ctest-nginx-svc-49682764
2026-02-12 03:52:50,981 - DEBUG - No XMPP flaps were noticed during the test
2026-02-12 03:52:50,982 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11]
2026-02-12 03:52:50,982 - INFO - --------------------------------------------------------------------------------
2026-02-12 03:52:50,986 - INFO - Deleting pod ctest-new-default-94288548:ctest-pod-30783544
2026-02-12 03:52:50,987 - INFO - Deleting pod ctest-new-default-94288548:ctest-pod-77980247
2026-02-12 03:52:50,987 - INFO - Deleting pod ctest-non-default-05833981:ctest-pod-88304533
2026-02-12 03:52:50,988 - INFO - Deleting pod ctest-non-default-05833981:ctest-pod-51393113
2026-02-12 03:52:50,988 - INFO - Deleting pod ctest-new-default-94288548:ctest-pod-61473751
2026-02-12 03:52:50,988 - INFO - Deleting pod ctest-new-default-94288548:ctest-pod-76332043
2026-02-12 03:52:50,988 - INFO - Deleting pod ctest-non-default-05833981:ctest-pod-66092433
2026-02-12 03:52:50,989 - INFO - Deleting pod ctest-non-default-05833981:ctest-pod-65933478
2026-02-12 03:52:51,141 - WARNING - Pod uuid 45676014-602d-41c9-95d4-d63cee17f7f1 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:51,142 - WARNING - Pod uuid 36b176de-5397-45f3-9ee2-101911da43bc is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:51,142 - WARNING - Pod uuid 1f2abd4d-b979-4b48-a3db-7907a611f0a4 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:51,143 - WARNING - Pod uuid 5b5859c2-e638-4ef7-904c-6291025f13a8 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:51,144 - WARNING - Pod uuid ac1475ff-933a-4ecc-816d-1510ceff1e9a is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:51,144 - WARNING - Pod uuid d6dea3a5-837d-47f8-bfa2-2ea4c6dc08ed is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:51,144 - WARNING - Pod uuid dc6163ac-f157-4da8-aa85-b3b9d9293db4 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:51,144 - WARNING - Pod uuid d5618a52-e184-42ee-9d49-7a7e53fbfe73 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:56,169 - WARNING - Pod uuid ac1475ff-933a-4ecc-816d-1510ceff1e9a is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:56,171 - DEBUG - Pod d6dea3a5-837d-47f8-bfa2-2ea4c6dc08ed is not in agent 10.0.0.50 VM list
2026-02-12 03:52:56,172 - DEBUG - Pod dc6163ac-f157-4da8-aa85-b3b9d9293db4 is not in agent 10.0.0.50 VM list
2026-02-12 03:52:56,173 - DEBUG - Pod 36b176de-5397-45f3-9ee2-101911da43bc is not in agent 10.0.0.50 VM list
2026-02-12 03:52:56,174 - DEBUG - Pod 45676014-602d-41c9-95d4-d63cee17f7f1 is not in agent 10.0.0.50 VM list
2026-02-12 03:52:56,175 - WARNING - Pod uuid 5b5859c2-e638-4ef7-904c-6291025f13a8 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:56,175 - WARNING - Pod uuid 1f2abd4d-b979-4b48-a3db-7907a611f0a4 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:56,184 - WARNING - Pod uuid d5618a52-e184-42ee-9d49-7a7e53fbfe73 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:52:56,206 - DEBUG - VMI d03c1640-07c5-11f1-be85-fa163e899621 is removed from agent 10.0.0.50
2026-02-12 03:52:56,206 - INFO - Verified that pod ctest-pod-77980247 is removed in agent
2026-02-12 03:52:56,206 - DEBUG - VMI cfc24e78-07c5-11f1-be85-fa163e899621 is removed from agent 10.0.0.50
2026-02-12 03:52:56,207 - INFO - Verified that pod ctest-pod-30783544 is removed in agent
2026-02-12 03:52:56,207 - DEBUG - VMI d1394f90-07c5-11f1-be85-fa163e899621 is removed from agent 10.0.0.50
2026-02-12 03:52:56,207 - INFO - Verified that pod ctest-pod-51393113 is removed in agent
2026-02-12 03:52:56,207 - DEBUG - VMI d0ca5cde-07c5-11f1-be85-fa163e899621 is removed from agent 10.0.0.50
2026-02-12 03:52:56,207 - INFO - Verified that pod ctest-pod-88304533 is removed in agent
2026-02-12 03:53:01,179 - WARNING - Pod uuid ac1475ff-933a-4ecc-816d-1510ceff1e9a is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:01,184 - WARNING - Pod uuid 1f2abd4d-b979-4b48-a3db-7907a611f0a4 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:01,191 - WARNING - Pod uuid 5b5859c2-e638-4ef7-904c-6291025f13a8 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:01,196 - WARNING - Pod uuid d5618a52-e184-42ee-9d49-7a7e53fbfe73 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:06,186 - WARNING - Pod uuid ac1475ff-933a-4ecc-816d-1510ceff1e9a is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:06,194 - WARNING - Pod uuid 1f2abd4d-b979-4b48-a3db-7907a611f0a4 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:06,199 - WARNING - Pod uuid 5b5859c2-e638-4ef7-904c-6291025f13a8 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:06,204 - WARNING - Pod uuid d5618a52-e184-42ee-9d49-7a7e53fbfe73 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:11,193 - WARNING - Pod uuid ac1475ff-933a-4ecc-816d-1510ceff1e9a is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:11,200 - WARNING - Pod uuid 1f2abd4d-b979-4b48-a3db-7907a611f0a4 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:11,206 - WARNING - Pod uuid 5b5859c2-e638-4ef7-904c-6291025f13a8 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:11,210 - WARNING - Pod uuid d5618a52-e184-42ee-9d49-7a7e53fbfe73 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:16,202 - WARNING - Pod uuid ac1475ff-933a-4ecc-816d-1510ceff1e9a is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:16,206 - WARNING - Pod uuid 1f2abd4d-b979-4b48-a3db-7907a611f0a4 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:16,213 - WARNING - Pod uuid 5b5859c2-e638-4ef7-904c-6291025f13a8 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:16,217 - WARNING - Pod uuid d5618a52-e184-42ee-9d49-7a7e53fbfe73 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:21,233 - WARNING - Pod uuid 1f2abd4d-b979-4b48-a3db-7907a611f0a4 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:21,233 - WARNING - Pod uuid ac1475ff-933a-4ecc-816d-1510ceff1e9a is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:21,234 - WARNING - Pod uuid 5b5859c2-e638-4ef7-904c-6291025f13a8 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:21,234 - WARNING - Pod uuid d5618a52-e184-42ee-9d49-7a7e53fbfe73 is still seen in agent 10.0.0.50 VM list
2026-02-12 03:53:26,248 - DEBUG - Pod ac1475ff-933a-4ecc-816d-1510ceff1e9a is not in agent 10.0.0.50 VM list
2026-02-12 03:53:26,250 - DEBUG - Pod 5b5859c2-e638-4ef7-904c-6291025f13a8 is not in agent 10.0.0.50 VM list
2026-02-12 03:53:26,251 - DEBUG - Pod 1f2abd4d-b979-4b48-a3db-7907a611f0a4 is not in agent 10.0.0.50 VM list
2026-02-12 03:53:26,252 - DEBUG - Pod d5618a52-e184-42ee-9d49-7a7e53fbfe73 is not in agent 10.0.0.50 VM list
2026-02-12 03:53:26,263 - DEBUG - VMI d2ef9556-07c5-11f1-be85-fa163e899621 is removed from agent 10.0.0.50
2026-02-12 03:53:26,263 - INFO - Verified that pod ctest-pod-65933478 is removed in agent
2026-02-12 03:53:26,263 - DEBUG - VMI d212d0a8-07c5-11f1-be85-fa163e899621 is removed from agent 10.0.0.50
2026-02-12 03:53:26,263 - INFO - Verified that pod ctest-pod-76332043 is removed in agent
2026-02-12 03:53:26,265 - DEBUG - VMI d28a3b34-07c5-11f1-be85-fa163e899621 is removed from agent 10.0.0.50
2026-02-12 03:53:26,265 - INFO - Verified that pod ctest-pod-66092433 is removed in agent
2026-02-12 03:53:26,265 - DEBUG - VMI d1ae731a-07c5-11f1-be85-fa163e899621 is removed from agent 10.0.0.50
2026-02-12 03:53:26,265 - INFO - Verified that pod ctest-pod-61473751 is removed in agent
2026-02-12 03:53:26,266 - INFO - Deleting namespace ctest-non-default-05833981
2026-02-12 03:53:26,282 - DEBUG - Namespace ctest-non-default-05833981 still in k8s
2026-02-12 03:53:28,286 - DEBUG - Namespace ctest-non-default-05833981 still in k8s
2026-02-12 03:53:30,293 - DEBUG - Namespace ctest-non-default-05833981 still in k8s
2026-02-12 03:53:32,296 - DEBUG - Namespace ctest-non-default-05833981 is not in k8s
2026-02-12 03:53:32,296 - DEBUG - No need to check project deletion in contrail-api
2026-02-12 03:53:32,297 - INFO - Deleting namespace ctest-new-default-94288548
2026-02-12 03:53:32,306 - DEBUG - Namespace ctest-new-default-94288548 still in k8s
2026-02-12 03:53:34,311 - DEBUG - Namespace ctest-new-default-94288548 still in k8s
2026-02-12 03:53:36,316 - DEBUG - Namespace ctest-new-default-94288548 still in k8s
2026-02-12 03:53:38,319 - DEBUG - Namespace ctest-new-default-94288548 is not in k8s
2026-02-12 03:53:38,319 - DEBUG - No need to check project deletion in contrail-api