2025-01-16 02:18:21,721 - INFO - Using existing project ['default-domain', 'k8s-default'](dfcb70a5-c83d-43b1-9a7b-04af09abeffc)
2025-01-16 02:18:21,740 - DEBUG - Namespace ctest-new-default-28572253 not present
2025-01-16 02:18:21,752 - INFO - Created namespace ctest-new-default-28572253
2025-01-16 02:18:24,757 - DEBUG - Namespace ctest-non-default-29966283 not present
2025-01-16 02:18:24,771 - INFO - Created namespace ctest-non-default-29966283
2025-01-16 02:18:27,788 - DEBUG - Pod ctest-pod-44499447 not present
2025-01-16 02:18:27,788 - INFO - Creating Pod ctest-pod-44499447
2025-01-16 02:18:27,821 - DEBUG - Pod : ctest-pod-44499447 UUID is 64382505-04f3-4990-b4c2-58c00ff0ab82
2025-01-16 02:18:27,823 - DEBUG - Pod ctest-pod-98160883 not present
2025-01-16 02:18:27,823 - INFO - Creating Pod ctest-pod-98160883
2025-01-16 02:18:27,877 - DEBUG - Pod : ctest-pod-98160883 UUID is 2001924d-ec20-4724-96a3-a1ec394c1901
2025-01-16 02:18:27,881 - DEBUG - Pod ctest-pod-92481956 not present
2025-01-16 02:18:27,881 - INFO - Creating Pod ctest-pod-92481956
2025-01-16 02:18:27,905 - DEBUG - Pod : ctest-pod-92481956 UUID is a330010b-4f7c-498b-9b5f-a0f7cc43fbbd
2025-01-16 02:18:27,908 - DEBUG - Pod ctest-pod-42365095 not present
2025-01-16 02:18:27,908 - INFO - Creating Pod ctest-pod-42365095
2025-01-16 02:18:27,963 - DEBUG - Pod : ctest-pod-42365095 UUID is 9eb5b467-b1af-4b77-8ca8-1fe902cd9be1
2025-01-16 02:18:27,965 - DEBUG - Pod ctest-pod-80581911 not present
2025-01-16 02:18:27,966 - INFO - Creating Pod ctest-pod-80581911
2025-01-16 02:18:27,984 - DEBUG - Pod : ctest-pod-80581911 UUID is ed303b3b-0ccb-464e-8968-864e268bba4f
2025-01-16 02:18:27,987 - DEBUG - Pod ctest-pod-29856208 not present
2025-01-16 02:18:27,987 - INFO - Creating Pod ctest-pod-29856208
2025-01-16 02:18:28,010 - DEBUG - Pod : ctest-pod-29856208 UUID is 5bbc820b-2464-446d-b759-2ba03a2a10d8
2025-01-16 02:18:28,013 - DEBUG - Pod ctest-pod-97499432 not present
2025-01-16 02:18:28,013 - INFO - Creating Pod ctest-pod-97499432
2025-01-16 02:18:28,029 - DEBUG - Pod : ctest-pod-97499432 UUID is f2920bea-a7e4-4f31-bc7c-401dc79dfb6e
2025-01-16 02:18:28,031 - DEBUG - Pod ctest-pod-71740695 not present
2025-01-16 02:18:28,032 - INFO - Creating Pod ctest-pod-71740695
2025-01-16 02:18:28,053 - DEBUG - Pod : ctest-pod-71740695 UUID is ff28d090-c6fb-42bb-9036-8bccd13fd521
2025-01-16 02:18:28,246 - INFO - Project default-domain:k8s-ctest-new-default-28572253 for Namespace ctest-new-default-28572253 is seen in contrail-api
2025-01-16 02:18:28,246 - DEBUG - Project uuid in Contrail is 21bdf7ae-cd52-4a4d-b959-2beadb95f2fd
2025-01-16 02:18:28,471 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_NamespaceDatabaseList?namespace_uuid=6e86c543-d6b7-46c9-b52f-d94de90a3610
2025-01-16 02:18:28,483 - INFO - Namespace ctest-new-default-28572253 with uuid 6e86c543-d6b7-46c9-b52f-d94de90a3610 found in kube manager
2025-01-16 02:18:28,483 - INFO - Namespace ctest-new-default-28572253 verification passed
2025-01-16 02:18:28,763 - INFO - Project default-domain:k8s-ctest-non-default-29966283 for Namespace ctest-non-default-29966283 is seen in contrail-api
2025-01-16 02:18:28,763 - DEBUG - Project uuid in Contrail is e9d0621c-86b8-4252-b8a3-6ee454f13a97
2025-01-16 02:18:28,763 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_NamespaceDatabaseList?namespace_uuid=fd4bf714-0908-436b-905a-62cdb6ae80c2
2025-01-16 02:18:28,768 - INFO - Namespace ctest-non-default-29966283 with uuid fd4bf714-0908-436b-905a-62cdb6ae80c2 found in kube manager
2025-01-16 02:18:28,768 - INFO - Namespace ctest-non-default-29966283 verification passed
2025-01-16 02:18:28,774 - DEBUG - Pod ctest-pod-44499447 not in running state.Currently in Pending
2025-01-16 02:18:33,784 - DEBUG - Pod ctest-pod-44499447 not in running state.Currently in Pending
2025-01-16 02:18:38,793 - INFO - Pod ctest-pod-44499447 is in running state.Got IP 10.47.255.251
2025-01-16 02:18:38,810 - DEBUG - Pod ctest-pod-44499447 has vmi 2d48dfb2-d3b0-11ef-8f2a-fa163ea0907a
2025-01-16 02:18:38,810 - INFO - Verified pod ctest-pod-44499447 in contrail-api
2025-01-16 02:18:38,826 - DEBUG - VMI 2d48dfb2-d3b0-11ef-8f2a-fa163ea0907a is active in agent 10.0.0.42
2025-01-16 02:18:38,826 - INFO - Verified Pod ctest-pod-44499447 in agent 10.0.0.42
2025-01-16 02:18:38,826 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_VirtualMachineDatabaseList?x=64382505-04f3-4990-b4c2-58c00ff0ab82
2025-01-16 02:18:38,833 - INFO - Pod ctest-pod-44499447 with uuid 64382505-04f3-4990-b4c2-58c00ff0ab82 found in kube manager
2025-01-16 02:18:38,833 - INFO - Pod ctest-pod-44499447 verification passed
2025-01-16 02:18:38,839 - DEBUG - Pod ctest-pod-98160883 not in running state.Currently in Pending
2025-01-16 02:18:43,847 - INFO - Pod ctest-pod-98160883 is in running state.Got IP 10.47.255.250
2025-01-16 02:18:43,864 - DEBUG - Pod ctest-pod-98160883 has vmi 2dc5ea5c-d3b0-11ef-8f2a-fa163ea0907a
2025-01-16 02:18:43,864 - INFO - Verified pod ctest-pod-98160883 in contrail-api
2025-01-16 02:18:43,880 - DEBUG - VMI 2dc5ea5c-d3b0-11ef-8f2a-fa163ea0907a is active in agent 10.0.0.42
2025-01-16 02:18:43,880 - INFO - Verified Pod ctest-pod-98160883 in agent 10.0.0.42
2025-01-16 02:18:43,881 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_VirtualMachineDatabaseList?x=2001924d-ec20-4724-96a3-a1ec394c1901
2025-01-16 02:18:43,887 - INFO - Pod ctest-pod-98160883 with uuid 2001924d-ec20-4724-96a3-a1ec394c1901 found in kube manager
2025-01-16 02:18:43,887 - INFO - Pod ctest-pod-98160883 verification passed
2025-01-16 02:18:43,894 - INFO - Pod ctest-pod-92481956 is in running state.Got IP 10.47.255.249
2025-01-16 02:18:43,958 - DEBUG - Pod ctest-pod-92481956 has vmi 2e97900c-d3b0-11ef-8f2a-fa163ea0907a
2025-01-16 02:18:43,958 - INFO - Verified pod ctest-pod-92481956 in contrail-api
2025-01-16 02:18:43,974 - DEBUG - VMI 2e97900c-d3b0-11ef-8f2a-fa163ea0907a is active in agent 10.0.0.42
2025-01-16 02:18:43,974 - INFO - Verified Pod ctest-pod-92481956 in agent 10.0.0.42
2025-01-16 02:18:43,975 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_VirtualMachineDatabaseList?x=a330010b-4f7c-498b-9b5f-a0f7cc43fbbd
2025-01-16 02:18:43,980 - INFO - Pod ctest-pod-92481956 with uuid a330010b-4f7c-498b-9b5f-a0f7cc43fbbd found in kube manager
2025-01-16 02:18:43,980 - INFO - Pod ctest-pod-92481956 verification passed
2025-01-16 02:18:43,986 - INFO - Pod ctest-pod-42365095 is in running state.Got IP 10.47.255.248
2025-01-16 02:18:44,043 - DEBUG - Pod ctest-pod-42365095 has vmi 2f21724a-d3b0-11ef-8f2a-fa163ea0907a
2025-01-16 02:18:44,043 - INFO - Verified pod ctest-pod-42365095 in contrail-api
2025-01-16 02:18:44,059 - DEBUG - VMI 2f21724a-d3b0-11ef-8f2a-fa163ea0907a is active in agent 10.0.0.42
2025-01-16 02:18:44,059 - INFO - Verified Pod ctest-pod-42365095 in agent 10.0.0.42
2025-01-16 02:18:44,060 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_VirtualMachineDatabaseList?x=9eb5b467-b1af-4b77-8ca8-1fe902cd9be1
2025-01-16 02:18:44,065 - INFO - Pod ctest-pod-42365095 with uuid 9eb5b467-b1af-4b77-8ca8-1fe902cd9be1 found in kube manager
2025-01-16 02:18:44,066 - INFO - Pod ctest-pod-42365095 verification passed
2025-01-16 02:18:44,071 - INFO - Pod ctest-pod-80581911 is in running state.Got IP 10.47.255.247
2025-01-16 02:18:44,087 - DEBUG - Pod ctest-pod-80581911 has vmi 2fcfcf20-d3b0-11ef-8f2a-fa163ea0907a
2025-01-16 02:18:44,087 - INFO - Verified pod ctest-pod-80581911 in contrail-api
2025-01-16 02:18:44,102 - DEBUG - VMI 2fcfcf20-d3b0-11ef-8f2a-fa163ea0907a is active in agent 10.0.0.42
2025-01-16 02:18:44,102 - INFO - Verified Pod ctest-pod-80581911 in agent 10.0.0.42
2025-01-16 02:18:44,102 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_VirtualMachineDatabaseList?x=ed303b3b-0ccb-464e-8968-864e268bba4f
2025-01-16 02:18:44,108 - INFO - Pod ctest-pod-80581911 with uuid ed303b3b-0ccb-464e-8968-864e268bba4f found in kube manager
2025-01-16 02:18:44,108 - INFO - Pod ctest-pod-80581911 verification passed
2025-01-16 02:18:44,116 - INFO - Pod ctest-pod-97499432 is in running state.Got IP 10.47.255.245
2025-01-16 02:18:44,174 - DEBUG - Pod ctest-pod-97499432 has vmi 30e2ca20-d3b0-11ef-8f2a-fa163ea0907a
2025-01-16 02:18:44,174 - INFO - Verified pod ctest-pod-97499432 in contrail-api
2025-01-16 02:18:44,191 - DEBUG - VMI 30e2ca20-d3b0-11ef-8f2a-fa163ea0907a is active in agent 10.0.0.42
2025-01-16 02:18:44,191 - INFO - Verified Pod ctest-pod-97499432 in agent 10.0.0.42
2025-01-16 02:18:44,191 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_VirtualMachineDatabaseList?x=f2920bea-a7e4-4f31-bc7c-401dc79dfb6e
2025-01-16 02:18:44,197 - INFO - Pod ctest-pod-97499432 with uuid f2920bea-a7e4-4f31-bc7c-401dc79dfb6e found in kube manager
2025-01-16 02:18:44,197 - INFO - Pod ctest-pod-97499432 verification passed
2025-01-16 02:18:44,203 - DEBUG - Pod ctest-pod-29856208 not in running state.Currently in Pending
2025-01-16 02:18:49,211 - INFO - Pod ctest-pod-29856208 is in running state.Got IP 10.47.255.246
2025-01-16 02:18:49,227 - DEBUG - Pod ctest-pod-29856208 has vmi 305eea98-d3b0-11ef-8f2a-fa163ea0907a
2025-01-16 02:18:49,227 - INFO - Verified pod ctest-pod-29856208 in contrail-api
2025-01-16 02:18:49,243 - DEBUG - VMI 305eea98-d3b0-11ef-8f2a-fa163ea0907a is active in agent 10.0.0.42
2025-01-16 02:18:49,243 - INFO - Verified Pod ctest-pod-29856208 in agent 10.0.0.42
2025-01-16 02:18:49,243 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_VirtualMachineDatabaseList?x=5bbc820b-2464-446d-b759-2ba03a2a10d8
2025-01-16 02:18:49,249 - INFO - Pod ctest-pod-29856208 with uuid 5bbc820b-2464-446d-b759-2ba03a2a10d8 found in kube manager
2025-01-16 02:18:49,249 - INFO - Pod ctest-pod-29856208 verification passed
2025-01-16 02:18:49,254 - INFO - Pod ctest-pod-71740695 is in running state.Got IP 10.47.255.244
2025-01-16 02:18:49,314 - DEBUG - Pod ctest-pod-71740695 has vmi 31656570-d3b0-11ef-8f2a-fa163ea0907a
2025-01-16 02:18:49,314 - INFO - Verified pod ctest-pod-71740695 in contrail-api
2025-01-16 02:18:49,333 - DEBUG - VMI 31656570-d3b0-11ef-8f2a-fa163ea0907a is active in agent 10.0.0.42
2025-01-16 02:18:49,333 - INFO - Verified Pod ctest-pod-71740695 in agent 10.0.0.42
2025-01-16 02:18:49,333 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_VirtualMachineDatabaseList?x=ff28d090-c6fb-42bb-9036-8bccd13fd521
2025-01-16 02:18:49,338 - INFO - Pod ctest-pod-71740695 with uuid ff28d090-c6fb-42bb-9036-8bccd13fd521 found in kube manager
2025-01-16 02:18:49,338 - INFO - Pod ctest-pod-71740695 verification passed
2025-01-16 02:18:49,339 - INFO - ================================================================================
2025-01-16 02:18:49,339 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-01-16 02:18:49,339 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-01-16 02:18:49,588 - DEBUG - Nothing to compare xmpp stats {'10.0.0.42': {'10.0.0.58': '0'}} with
2025-01-16 02:18:49,588 - INFO - Initial checks done. Running the testcase now
2025-01-16 02:18:49,588 - INFO -
2025-01-16 02:18:49,659 - DEBUG - [Pod ctest-pod-44499447] Cmd: echo ctest-pod-44499447 > /usr/share/nginx/html/index.html, Output:
2025-01-16 02:18:49,736 - DEBUG - [Pod ctest-pod-98160883] Cmd: echo ctest-pod-98160883 > /usr/share/nginx/html/index.html, Output:
2025-01-16 02:18:49,809 - DEBUG - [Pod ctest-pod-92481956] Cmd: echo ctest-pod-92481956 > /usr/share/nginx/html/index.html, Output:
2025-01-16 02:18:49,891 - DEBUG - [Pod ctest-pod-42365095] Cmd: echo ctest-pod-42365095 > /usr/share/nginx/html/index.html, Output:
2025-01-16 02:18:49,895 - DEBUG - Service ctest-nginx-svc-01134534 not present
2025-01-16 02:18:49,896 - INFO - Creating service ctest-nginx-svc-01134534
2025-01-16 02:18:49,913 - INFO - Created Service ctest-nginx-svc-01134534
2025-01-16 02:18:49,921 - WARNING - Service UUID 7c792ad2-349e-4b17-a681-cf219d3a84a8 not yet found in contrail-api
2025-01-16 02:18:50,950 - INFO - Validated that Service ctest-nginx-svc-01134534 is seen in contrail-api
2025-01-16 02:18:50,950 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_LoadbalancerDatabaseList?x=7c792ad2-349e-4b17-a681-cf219d3a84a8
2025-01-16 02:18:50,955 - INFO - Service ctest-nginx-svc-01134534 with uuid 7c792ad2-349e-4b17-a681-cf219d3a84a8 found in kube manager
2025-01-16 02:18:50,955 - INFO - Service ctest-nginx-svc-01134534 verification passed
2025-01-16 02:18:52,037 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44499447
2025-01-16 02:18:52,037 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:18:52,038 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44499447
2025-01-16 02:18:52,096 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:18:52,096 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:18:52,096 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:18:52,423 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44499447
2025-01-16 02:18:52,424 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:18:52,424 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44499447
2025-01-16 02:18:52,485 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-98160883
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:18:52,485 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:18:52,485 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: ctest-pod-98160883
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:18:52,485 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44499447': 3, 'ctest-pod-98160883': 1}
2025-01-16 02:18:52,556 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:18:52,556 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:18:52,556 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:18:52,680 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:18:52,680 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:18:52,680 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:18:52,755 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44499447
2025-01-16 02:18:52,755 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:18:52,755 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44499447
2025-01-16 02:18:52,816 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-98160883
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:18:52,817 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:18:52,817 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: ctest-pod-98160883
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:18:52,817 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44499447': 3, 'ctest-pod-98160883': 1}
2025-01-16 02:18:52,821 - DEBUG - Network policy ingress-on-service not present
2025-01-16 02:18:52,821 - INFO - Creating Network Policy ingress-on-service
2025-01-16 02:18:52,842 - INFO - Network policy found in k8s
2025-01-16 02:18:52,842 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=85a5d466-5cd8-43da-86d5-b2b4b051a53e
2025-01-16 02:18:52,852 - INFO - Network Policy ingress-on-service with uuid 85a5d466-5cd8-43da-86d5-b2b4b051a53e found in kube manager
2025-01-16 02:18:52,889 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-01-16 02:18:52,890 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-01-16 02:18:52,890 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=85a5d466-5cd8-43da-86d5-b2b4b051a53e
2025-01-16 02:18:52,924 - WARNING - Network policy with name ingress-on-service not found in agent
2025-01-16 02:18:54,926 - DEBUG - Requesting: http://10.0.0.58:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=85a5d466-5cd8-43da-86d5-b2b4b051a53e
2025-01-16 02:18:54,964 - INFO - Network policy with name ingress-on-service found in agent
2025-01-16 02:18:54,964 - INFO - Network Policy ingress-on-service verification passed
2025-01-16 02:19:00,036 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:00,037 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:00,037 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:05,091 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:05,092 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:05,092 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:10,150 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:10,150 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:10,150 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:15,232 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:15,232 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:15,232 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:20,287 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:20,287 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:20,287 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:25,352 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:25,352 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:25,352 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:30,408 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:30,408 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:30,408 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:35,470 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:35,470 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:35,471 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:40,560 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:40,560 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:40,560 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:45,635 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:45,636 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:45,636 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:45,636 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-44499447': 0, 'ctest-pod-98160883': 0}
2025-01-16 02:19:45,699 - DEBUG - [Pod ctest-pod-29856208] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:19:45,700 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:19:45,700 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:19:45,779 - DEBUG - [Pod ctest-pod-29856208] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-98160883
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:19:45,779 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:19:45,779 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd output: ctest-pod-98160883
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:19:45,779 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44499447': 1, 'ctest-pod-98160883': 1}
2025-01-16 02:19:50,849 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:50,849 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:50,849 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:55,915 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:55,916 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:19:55,916 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:00,974 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:00,975 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:00,975 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:06,031 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:06,031 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:06,031 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:11,107 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:11,107 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:11,107 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:16,167 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:16,167 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:16,167 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:21,230 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:21,231 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:21,231 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:26,305 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:26,305 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:26,305 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:31,384 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:31,385 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:31,385 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:36,461 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:36,461 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:36,461 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:36,461 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-44499447': 0, 'ctest-pod-98160883': 0}
2025-01-16 02:20:38,519 - DEBUG - [Pod ctest-pod-29856208] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.088 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.412/1.088 ms
2025-01-16 02:20:38,519 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29856208 with expectation True passed
2025-01-16 02:20:40,586 - DEBUG - [Pod ctest-pod-80581911] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.333 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.162/0.333 ms
2025-01-16 02:20:40,586 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80581911 with expectation True passed
2025-01-16 02:20:42,654 - DEBUG - [Pod ctest-pod-97499432] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=3.417 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.734 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.088/1.413/3.417 ms
2025-01-16 02:20:42,654 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-97499432 with expectation True passed
2025-01-16 02:20:42,732 - DEBUG - [Pod ctest-pod-29856208] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-16 02:20:42,732 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-16 02:20:42,732 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-16 02:20:42,732 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29856208 passed
2025-01-16 02:20:42,801 - DEBUG - [Pod ctest-pod-29856208] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-16 02:20:42,801 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-16 02:20:42,801 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-16 02:20:42,801 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29856208 passed
2025-01-16 02:20:47,875 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-16 02:20:47,875 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-16 02:20:47,875 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-16 02:20:47,875 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80581911 passed
2025-01-16 02:20:52,944 - DEBUG - [Pod ctest-pod-71740695] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-16 02:20:52,944 - DEBUG - [Pod Pod ctest-pod-71740695] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-16 02:20:52,944 - DEBUG - [Pod Pod ctest-pod-71740695] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-16 02:20:52,944 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71740695 passed
2025-01-16 02:20:52,952 - INFO - Updating Network Policy ingress-on-service
2025-01-16 02:20:58,030 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:58,030 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:20:58,030 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:03,109 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:03,110 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:03,110 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:08,184 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:08,184 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:08,184 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:13,257 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:13,257 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:13,257 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:18,335 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:18,335 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:18,335 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:23,425 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:23,425 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:23,425 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:28,497 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:28,498 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:28,498 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:33,571 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:33,571 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:33,571 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:38,638 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:38,638 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:38,638 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:43,710 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:43,710 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:43,710 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
wget: download timed out
2025-01-16 02:21:43,710 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-44499447': 0, 'ctest-pod-98160883': 0}
2025-01-16 02:21:43,779 - DEBUG - [Pod ctest-pod-29856208] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
ctest-pod-98160883
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:43,779 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:21:43,779 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
ctest-pod-98160883
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:43,845 - DEBUG - [Pod ctest-pod-29856208] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-98160883
2025-01-16 02:21:43,845 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:21:43,845 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-98160883
2025-01-16 02:21:43,921 - DEBUG - [Pod ctest-pod-29856208] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-98160883
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:43,921 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:21:43,921 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd output: ctest-pod-98160883
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:43,985 - DEBUG - [Pod ctest-pod-29856208] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:43,985 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:21:43,985 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:43,985 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44499447': 1, 'ctest-pod-98160883': 3}
2025-01-16 02:21:44,040 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:44,040 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:21:44,040 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:44,092 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:44,092 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:21:44,092 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:44,155 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44499447
2025-01-16 02:21:44,155 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:21:44,155 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44499447
2025-01-16 02:21:44,227 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44499447
2025-01-16 02:21:44,227 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:21:44,227 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44499447
2025-01-16 02:21:44,294 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:44,295 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:21:44,295 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: ctest-pod-44499447
Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-16 02:21:44,360 - DEBUG - [Pod ctest-pod-97499432] Cmd: wget http://10.106.2.212:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-98160883
2025-01-16 02:21:44,360 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd wget http://10.106.2.212:80/ -O - -T 5 -t 1 passed
2025-01-16 02:21:44,360 - DEBUG - [Pod Pod ctest-pod-97499432] Cmd output: Connecting to 10.106.2.212:80 (10.106.2.212:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-98160883
2025-01-16 02:21:44,360 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44499447': 5, 'ctest-pod-98160883': 1}
2025-01-16 02:21:46,428 - DEBUG - [Pod ctest-pod-29856208] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.624 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.092 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.102 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.092/0.272/0.624 ms
2025-01-16 02:21:46,428 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29856208 with expectation True passed
2025-01-16 02:21:48,497 - DEBUG - [Pod ctest-pod-80581911] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.846 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.136 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.105/0.362/0.846 ms
2025-01-16 02:21:48,497 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80581911 with expectation True passed
2025-01-16 02:21:50,567 - DEBUG - [Pod ctest-pod-97499432] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.193 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.156 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.067/0.472/1.193 ms
2025-01-16 02:21:50,567 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-97499432 with expectation True passed
2025-01-16 02:21:50,628 - DEBUG - [Pod ctest-pod-29856208] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-16 02:21:50,628 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-16 02:21:50,628 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-16 02:21:50,628 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29856208 passed
2025-01-16 02:21:50,712 - DEBUG - [Pod ctest-pod-29856208] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-16 02:21:50,712 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-16 02:21:50,712 - DEBUG - [Pod Pod ctest-pod-29856208] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-16 02:21:50,712 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29856208 passed
2025-01-16 02:21:55,770 - DEBUG - [Pod ctest-pod-80581911] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-16 02:21:55,771 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-16 02:21:55,771 - DEBUG - [Pod Pod ctest-pod-80581911] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-16 02:21:55,771 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80581911 passed
2025-01-16 02:21:55,924 - DEBUG - [Pod ctest-pod-71740695] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-16 02:21:55,925 - DEBUG - [Pod Pod ctest-pod-71740695] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-16 02:21:55,925 - DEBUG - [Pod Pod ctest-pod-71740695] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-16 02:21:55,925 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71740695 passed
2025-01-16 02:21:55,925 - INFO - Deleting Network Policy : ingress-on-service
2025-01-16 02:21:55,926 - INFO - Deleting service : ctest-nginx-svc-01134534
2025-01-16 02:21:56,181 - DEBUG - No XMPP flaps were noticed during the test
2025-01-16 02:21:56,182 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07]
2025-01-16 02:21:56,182 - INFO - --------------------------------------------------------------------------------
2025-01-16 02:21:56,189 - INFO - Deleting pod ctest-new-default-28572253:ctest-pod-44499447
2025-01-16 02:21:56,189 - INFO - Deleting pod ctest-new-default-28572253:ctest-pod-98160883
2025-01-16 02:21:56,190 - INFO - Deleting pod ctest-non-default-29966283:ctest-pod-92481956
2025-01-16 02:21:56,190 - INFO - Deleting pod ctest-non-default-29966283:ctest-pod-42365095
2025-01-16 02:21:56,191 - INFO - Deleting pod ctest-new-default-28572253:ctest-pod-80581911
2025-01-16 02:21:56,191 - INFO - Deleting pod ctest-new-default-28572253:ctest-pod-29856208
2025-01-16 02:21:56,191 - INFO - Deleting pod ctest-non-default-29966283:ctest-pod-97499432
2025-01-16 02:21:56,192 - INFO - Deleting pod ctest-non-default-29966283:ctest-pod-71740695
2025-01-16 02:21:56,381 - WARNING - Pod uuid 9eb5b467-b1af-4b77-8ca8-1fe902cd9be1 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:21:56,382 - WARNING - Pod uuid ed303b3b-0ccb-464e-8968-864e268bba4f is still seen in agent 10.0.0.42 VM list
2025-01-16 02:21:56,382 - WARNING - Pod uuid 5bbc820b-2464-446d-b759-2ba03a2a10d8 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:21:56,383 - WARNING - Pod uuid 64382505-04f3-4990-b4c2-58c00ff0ab82 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:21:56,385 - WARNING - Pod uuid ff28d090-c6fb-42bb-9036-8bccd13fd521 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:21:56,386 - WARNING - Pod uuid f2920bea-a7e4-4f31-bc7c-401dc79dfb6e is still seen in agent 10.0.0.42 VM list
2025-01-16 02:21:56,386 - WARNING - Pod uuid 2001924d-ec20-4724-96a3-a1ec394c1901 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:21:56,387 - WARNING - Pod uuid a330010b-4f7c-498b-9b5f-a0f7cc43fbbd is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:01,422 - DEBUG - Pod 9eb5b467-b1af-4b77-8ca8-1fe902cd9be1 is not in agent 10.0.0.42 VM list
2025-01-16 02:22:01,433 - DEBUG - Pod 2001924d-ec20-4724-96a3-a1ec394c1901 is not in agent 10.0.0.42 VM list
2025-01-16 02:22:01,436 - WARNING - Pod uuid 5bbc820b-2464-446d-b759-2ba03a2a10d8 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:01,438 - DEBUG - Pod a330010b-4f7c-498b-9b5f-a0f7cc43fbbd is not in agent 10.0.0.42 VM list
2025-01-16 02:22:01,441 - WARNING - Pod uuid f2920bea-a7e4-4f31-bc7c-401dc79dfb6e is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:01,442 - DEBUG - Pod 64382505-04f3-4990-b4c2-58c00ff0ab82 is not in agent 10.0.0.42 VM list
2025-01-16 02:22:01,445 - WARNING - Pod uuid ed303b3b-0ccb-464e-8968-864e268bba4f is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:01,450 - WARNING - Pod uuid ff28d090-c6fb-42bb-9036-8bccd13fd521 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:01,457 - DEBUG - VMI 2f21724a-d3b0-11ef-8f2a-fa163ea0907a is removed from agent 10.0.0.42
2025-01-16 02:22:01,457 - INFO - Verified that pod ctest-pod-42365095 is removed in agent
2025-01-16 02:22:01,473 - DEBUG - VMI 2d48dfb2-d3b0-11ef-8f2a-fa163ea0907a is removed from agent 10.0.0.42
2025-01-16 02:22:01,473 - INFO - Verified that pod ctest-pod-44499447 is removed in agent
2025-01-16 02:22:01,473 - DEBUG - VMI 2e97900c-d3b0-11ef-8f2a-fa163ea0907a is removed from agent 10.0.0.42
2025-01-16 02:22:01,474 - INFO - Verified that pod ctest-pod-92481956 is removed in agent
2025-01-16 02:22:01,474 - DEBUG - VMI 2dc5ea5c-d3b0-11ef-8f2a-fa163ea0907a is removed from agent 10.0.0.42
2025-01-16 02:22:01,474 - INFO - Verified that pod ctest-pod-98160883 is removed in agent
2025-01-16 02:22:06,446 - WARNING - Pod uuid 5bbc820b-2464-446d-b759-2ba03a2a10d8 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:06,456 - WARNING - Pod uuid f2920bea-a7e4-4f31-bc7c-401dc79dfb6e is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:06,457 - WARNING - Pod uuid ed303b3b-0ccb-464e-8968-864e268bba4f is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:06,461 - WARNING - Pod uuid ff28d090-c6fb-42bb-9036-8bccd13fd521 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:11,455 - WARNING - Pod uuid 5bbc820b-2464-446d-b759-2ba03a2a10d8 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:11,472 - WARNING - Pod uuid f2920bea-a7e4-4f31-bc7c-401dc79dfb6e is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:11,473 - WARNING - Pod uuid ff28d090-c6fb-42bb-9036-8bccd13fd521 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:11,474 - WARNING - Pod uuid ed303b3b-0ccb-464e-8968-864e268bba4f is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:16,467 - WARNING - Pod uuid 5bbc820b-2464-446d-b759-2ba03a2a10d8 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:16,492 - WARNING - Pod uuid f2920bea-a7e4-4f31-bc7c-401dc79dfb6e is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:16,494 - WARNING - Pod uuid ed303b3b-0ccb-464e-8968-864e268bba4f is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:16,495 - WARNING - Pod uuid ff28d090-c6fb-42bb-9036-8bccd13fd521 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:21,476 - WARNING - Pod uuid 5bbc820b-2464-446d-b759-2ba03a2a10d8 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:21,514 - WARNING - Pod uuid ff28d090-c6fb-42bb-9036-8bccd13fd521 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:21,515 - WARNING - Pod uuid f2920bea-a7e4-4f31-bc7c-401dc79dfb6e is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:21,515 - WARNING - Pod uuid ed303b3b-0ccb-464e-8968-864e268bba4f is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:26,505 - WARNING - Pod uuid 5bbc820b-2464-446d-b759-2ba03a2a10d8 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:26,531 - WARNING - Pod uuid ff28d090-c6fb-42bb-9036-8bccd13fd521 is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:26,534 - WARNING - Pod uuid ed303b3b-0ccb-464e-8968-864e268bba4f is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:26,534 - WARNING - Pod uuid f2920bea-a7e4-4f31-bc7c-401dc79dfb6e is still seen in agent 10.0.0.42 VM list
2025-01-16 02:22:31,515 - DEBUG - Pod 5bbc820b-2464-446d-b759-2ba03a2a10d8 is not in agent 10.0.0.42 VM list
2025-01-16 02:22:31,523 - DEBUG - VMI 305eea98-d3b0-11ef-8f2a-fa163ea0907a is removed from agent 10.0.0.42
2025-01-16 02:22:31,523 - INFO - Verified that pod ctest-pod-29856208 is removed in agent
2025-01-16 02:22:31,552 - DEBUG - Pod f2920bea-a7e4-4f31-bc7c-401dc79dfb6e is not in agent 10.0.0.42 VM list
2025-01-16 02:22:31,553 - DEBUG - Pod ed303b3b-0ccb-464e-8968-864e268bba4f is not in agent 10.0.0.42 VM list
2025-01-16 02:22:31,557 - DEBUG - Pod ff28d090-c6fb-42bb-9036-8bccd13fd521 is not in agent 10.0.0.42 VM list
2025-01-16 02:22:31,573 - DEBUG - VMI 30e2ca20-d3b0-11ef-8f2a-fa163ea0907a is removed from agent 10.0.0.42
2025-01-16 02:22:31,573 - INFO - Verified that pod ctest-pod-97499432 is removed in agent
2025-01-16 02:22:31,573 - DEBUG - VMI 2fcfcf20-d3b0-11ef-8f2a-fa163ea0907a is removed from agent 10.0.0.42
2025-01-16 02:22:31,573 - INFO - Verified that pod ctest-pod-80581911 is removed in agent
2025-01-16 02:22:31,575 - DEBUG - VMI 31656570-d3b0-11ef-8f2a-fa163ea0907a is removed from agent 10.0.0.42
2025-01-16 02:22:31,575 - INFO - Verified that pod ctest-pod-71740695 is removed in agent
2025-01-16 02:22:31,575 - INFO - Deleting namespace ctest-non-default-29966283
2025-01-16 02:22:31,605 - DEBUG - Namespace ctest-non-default-29966283 still in k8s
2025-01-16 02:22:33,610 - DEBUG - Namespace ctest-non-default-29966283 still in k8s
2025-01-16 02:22:35,618 - DEBUG - Namespace ctest-non-default-29966283 still in k8s
2025-01-16 02:22:37,622 - DEBUG - Namespace ctest-non-default-29966283 is not in k8s
2025-01-16 02:22:37,622 - DEBUG - No need to check project deletion in contrail-api
2025-01-16 02:22:37,622 - INFO - Deleting namespace ctest-new-default-28572253
2025-01-16 02:22:37,631 - DEBUG - Namespace ctest-new-default-28572253 still in k8s
2025-01-16 02:22:39,640 - DEBUG - Namespace ctest-new-default-28572253 still in k8s
2025-01-16 02:22:41,645 - DEBUG - Namespace ctest-new-default-28572253 still in k8s
2025-01-16 02:22:43,650 - DEBUG - Namespace ctest-new-default-28572253 is not in k8s
2025-01-16 02:22:43,650 - DEBUG - No need to check project deletion in contrail-api