2024-11-08 14:20:06,708 - DEBUG - [10.0.0.65]: Running cmd : hostname 2024-11-08 14:20:06,891 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2229-1 2024-11-08 14:20:06,891 - DEBUG - [10.0.0.65]: Running cmd : hostname -f 2024-11-08 14:20:06,951 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2229-1. 2024-11-08 14:20:06,951 - DEBUG - [10.0.0.65]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-11-08 14:20:07,077 - DEBUG - Output : NAMES contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:20:07,077 - DEBUG - [10.0.0.65]: Running cmd : getent hosts 10.0.0.65 | head -n 1 | awk '{print $2}' 2024-11-08 14:20:07,134 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2229-1. 2024-11-08 14:20:07,134 - DEBUG - [10.0.0.65]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-11-08 14:20:07,198 - DEBUG - Output : 10.0.0.65/24 172.17.0.1/16 10.20.0.29/24 2024-11-08 14:20:07,198 - DEBUG - [10.0.0.65]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-11-08 14:20:07,263 - DEBUG - Output : 10.20.0.29/24 2024-11-08 14:20:07,263 - DEBUG - [10.0.0.65]: Running cmd : getent hosts 10.20.0.29 | head -n 1 | awk '{print $2}' 2024-11-08 14:20:07,327 - DEBUG - Output : 2024-11-08 14:20:09,035 - INFO - Using existing project ['default-domain', 'admin'](83f464b6-3148-494c-acad-7a79684e5786) 2024-11-08 14:20:09,211 - INFO - ================================================================================ 2024-11-08 14:20:09,212 - INFO - STARTING TEST : test_contrail_status 2024-11-08 14:20:09,213 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2024-11-08 14:20:09,347 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:20:09,355 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.29': '0'}} with 2024-11-08 14:20:09,355 - INFO - Initial checks done. Running the testcase now 2024-11-08 14:20:09,355 - INFO - 2024-11-08 14:20:09,355 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-11-08 14:20:09,454 - DEBUG - Output : contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:20:09,454 - INFO - 10.0.0.65 2024-11-08 14:20:09,454 - INFO - config 2024-11-08 14:20:09,461 - INFO - config-nodemgr:active 2024-11-08 14:20:09,465 - INFO - api-server:active 2024-11-08 14:20:09,470 - INFO - schema:active 2024-11-08 14:20:09,474 - INFO - svc-monitor:active 2024-11-08 14:20:09,474 - INFO - device-manager:inactive 2024-11-08 14:20:09,474 - INFO - config-database 2024-11-08 14:20:09,474 - INFO - config-cassandra:active 2024-11-08 14:20:09,474 - INFO - config-zookeeper:active 2024-11-08 14:20:09,474 - INFO - config-rabbitmq:active 2024-11-08 14:20:09,474 - INFO - vrouter 2024-11-08 14:20:09,479 - INFO - vrouter-nodemgr:active 2024-11-08 14:20:09,484 - INFO - agent:active 2024-11-08 14:20:09,485 - INFO - control 2024-11-08 14:20:09,490 - INFO - control-nodemgr:active 2024-11-08 14:20:09,495 - INFO - control:active 2024-11-08 14:20:09,495 - INFO - named:active 2024-11-08 14:20:09,502 - INFO - dns:active 2024-11-08 14:20:09,502 - INFO - analytics 2024-11-08 14:20:09,507 - INFO - analytics-nodemgr:active 2024-11-08 14:20:09,511 - INFO - analytics-api:active 2024-11-08 14:20:09,517 - INFO - collector:active 2024-11-08 14:20:09,517 - INFO - analytics-database 2024-11-08 14:20:09,517 - INFO - analytics-cassandra:active 2024-11-08 14:20:09,522 - INFO - analyticsdb-nodemgr:active 2024-11-08 14:20:09,527 - INFO - query-engine:active 2024-11-08 14:20:09,527 - INFO - webui 2024-11-08 14:20:09,528 - INFO - webui:active 2024-11-08 14:20:09,528 - INFO - webui-middleware:active 2024-11-08 14:20:09,528 - INFO - redis:active 2024-11-08 14:20:09,528 - INFO - analytics_snmp 2024-11-08 14:20:09,532 - INFO - snmp-collector:active 2024-11-08 14:20:09,532 - INFO - snmp-topology:active 2024-11-08 14:20:09,532 - INFO - analytics_alarm 2024-11-08 14:20:09,532 - INFO - alarmgen:active 2024-11-08 14:20:09,532 - DEBUG - defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:20:09,532 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 0 2024-11-08 14:20:19,533 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-11-08 14:20:19,612 - DEBUG - Output : contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:20:19,612 - INFO - 10.0.0.65 2024-11-08 14:20:19,612 - INFO - config 2024-11-08 14:20:19,620 - INFO - config-nodemgr:active 2024-11-08 14:20:19,626 - INFO - api-server:active 2024-11-08 14:20:19,631 - INFO - schema:active 2024-11-08 14:20:19,636 - INFO - svc-monitor:active 2024-11-08 14:20:19,636 - INFO - device-manager:inactive 2024-11-08 14:20:19,636 - INFO - config-database 2024-11-08 14:20:19,636 - INFO - config-cassandra:active 2024-11-08 14:20:19,636 - INFO - config-zookeeper:active 2024-11-08 14:20:19,636 - INFO - config-rabbitmq:active 2024-11-08 14:20:19,636 - INFO - vrouter 2024-11-08 14:20:19,641 - INFO - vrouter-nodemgr:active 2024-11-08 14:20:19,646 - INFO - agent:active 2024-11-08 14:20:19,647 - INFO - control 2024-11-08 14:20:19,652 - INFO - control-nodemgr:active 2024-11-08 14:20:19,659 - INFO - control:active 2024-11-08 14:20:19,659 - INFO - named:active 2024-11-08 14:20:19,665 - INFO - dns:active 2024-11-08 14:20:19,665 - INFO - analytics 2024-11-08 14:20:19,670 - INFO - analytics-nodemgr:active 2024-11-08 14:20:19,675 - INFO - analytics-api:active 2024-11-08 14:20:19,681 - INFO - collector:active 2024-11-08 14:20:19,681 - INFO - analytics-database 2024-11-08 14:20:19,681 - INFO - analytics-cassandra:active 2024-11-08 14:20:19,687 - INFO - analyticsdb-nodemgr:active 2024-11-08 14:20:19,692 - INFO - query-engine:active 2024-11-08 14:20:19,692 - INFO - webui 2024-11-08 14:20:19,692 - INFO - webui:active 2024-11-08 14:20:19,692 - INFO - webui-middleware:active 2024-11-08 14:20:19,692 - INFO - redis:active 2024-11-08 14:20:19,692 - INFO - analytics_snmp 2024-11-08 14:20:19,696 - INFO - snmp-collector:active 2024-11-08 14:20:19,696 - INFO - snmp-topology:active 2024-11-08 14:20:19,697 - INFO - analytics_alarm 2024-11-08 14:20:19,697 - INFO - alarmgen:active 2024-11-08 14:20:19,697 - DEBUG - defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:20:19,697 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 1 2024-11-08 14:20:29,698 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-11-08 14:20:29,790 - DEBUG - Output : contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:20:29,790 - INFO - 10.0.0.65 2024-11-08 14:20:29,790 - INFO - config 2024-11-08 14:20:29,796 - INFO - config-nodemgr:active 2024-11-08 14:20:29,800 - INFO - api-server:active 2024-11-08 14:20:29,805 - INFO - schema:active 2024-11-08 14:20:29,809 - INFO - svc-monitor:active 2024-11-08 14:20:29,810 - INFO - device-manager:inactive 2024-11-08 14:20:29,810 - INFO - config-database 2024-11-08 14:20:29,810 - INFO - config-cassandra:active 2024-11-08 14:20:29,810 - INFO - config-zookeeper:active 2024-11-08 14:20:29,810 - INFO - config-rabbitmq:active 2024-11-08 14:20:29,810 - INFO - vrouter 2024-11-08 14:20:29,815 - INFO - vrouter-nodemgr:active 2024-11-08 14:20:29,820 - INFO - agent:active 2024-11-08 14:20:29,820 - INFO - control 2024-11-08 14:20:29,826 - INFO - control-nodemgr:active 2024-11-08 14:20:29,832 - INFO - control:active 2024-11-08 14:20:29,832 - INFO - named:active 2024-11-08 14:20:29,838 - INFO - dns:active 2024-11-08 14:20:29,838 - INFO - analytics 2024-11-08 14:20:29,843 - INFO - analytics-nodemgr:active 2024-11-08 14:20:29,848 - INFO - analytics-api:active 2024-11-08 14:20:29,853 - INFO - collector:active 2024-11-08 14:20:29,853 - INFO - analytics-database 2024-11-08 14:20:29,853 - INFO - analytics-cassandra:active 2024-11-08 14:20:29,858 - INFO - analyticsdb-nodemgr:active 2024-11-08 14:20:29,863 - INFO - query-engine:active 2024-11-08 14:20:29,863 - INFO - webui 2024-11-08 14:20:29,863 - INFO - webui:active 2024-11-08 14:20:29,863 - INFO - webui-middleware:active 2024-11-08 14:20:29,864 - INFO - redis:active 2024-11-08 14:20:29,864 - INFO - analytics_snmp 2024-11-08 14:20:29,868 - INFO - snmp-collector:active 2024-11-08 14:20:29,868 - INFO - snmp-topology:active 2024-11-08 14:20:29,868 - INFO - analytics_alarm 2024-11-08 14:20:29,868 - INFO - alarmgen:active 2024-11-08 14:20:29,868 - DEBUG - defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:20:29,868 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 2 2024-11-08 14:20:39,869 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-11-08 14:20:39,965 - DEBUG - Output : contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:20:39,966 - INFO - 10.0.0.65 2024-11-08 14:20:39,966 - INFO - config 2024-11-08 14:20:39,972 - INFO - config-nodemgr:active 2024-11-08 14:20:39,977 - INFO - api-server:active 2024-11-08 14:20:39,982 - INFO - schema:active 2024-11-08 14:20:39,986 - INFO - svc-monitor:active 2024-11-08 14:20:39,986 - INFO - device-manager:inactive 2024-11-08 14:20:39,986 - INFO - config-database 2024-11-08 14:20:39,987 - INFO - config-cassandra:active 2024-11-08 14:20:39,987 - INFO - config-zookeeper:active 2024-11-08 14:20:39,987 - INFO - config-rabbitmq:active 2024-11-08 14:20:39,987 - INFO - vrouter 2024-11-08 14:20:39,991 - INFO - vrouter-nodemgr:active 2024-11-08 14:20:39,996 - INFO - agent:active 2024-11-08 14:20:39,997 - INFO - control 2024-11-08 14:20:40,004 - INFO - control-nodemgr:active 2024-11-08 14:20:40,009 - INFO - control:active 2024-11-08 14:20:40,009 - INFO - named:active 2024-11-08 14:20:40,015 - INFO - dns:active 2024-11-08 14:20:40,015 - INFO - analytics 2024-11-08 14:20:40,020 - INFO - analytics-nodemgr:active 2024-11-08 14:20:40,024 - INFO - analytics-api:active 2024-11-08 14:20:40,029 - INFO - collector:active 2024-11-08 14:20:40,029 - INFO - analytics-database 2024-11-08 14:20:40,029 - INFO - analytics-cassandra:active 2024-11-08 14:20:40,035 - INFO - analyticsdb-nodemgr:active 2024-11-08 14:20:40,042 - INFO - query-engine:active 2024-11-08 14:20:40,042 - INFO - webui 2024-11-08 14:20:40,042 - INFO - webui:active 2024-11-08 14:20:40,042 - INFO - webui-middleware:active 2024-11-08 14:20:40,042 - INFO - redis:active 2024-11-08 14:20:40,042 - INFO - analytics_snmp 2024-11-08 14:20:40,046 - INFO - snmp-collector:active 2024-11-08 14:20:40,047 - INFO - snmp-topology:active 2024-11-08 14:20:40,047 - INFO - analytics_alarm 2024-11-08 14:20:40,047 - INFO - alarmgen:active 2024-11-08 14:20:40,047 - DEBUG - defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:20:40,047 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 3 2024-11-08 14:20:50,048 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-11-08 14:20:50,128 - DEBUG - Output : contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:20:50,128 - INFO - 10.0.0.65 2024-11-08 14:20:50,128 - INFO - config 2024-11-08 14:20:50,134 - INFO - config-nodemgr:active 2024-11-08 14:20:50,138 - INFO - api-server:active 2024-11-08 14:20:50,143 - INFO - schema:active 2024-11-08 14:20:50,148 - INFO - svc-monitor:active 2024-11-08 14:20:50,148 - INFO - device-manager:inactive 2024-11-08 14:20:50,148 - INFO - config-database 2024-11-08 14:20:50,148 - INFO - config-cassandra:active 2024-11-08 14:20:50,148 - INFO - config-zookeeper:active 2024-11-08 14:20:50,149 - INFO - config-rabbitmq:active 2024-11-08 14:20:50,149 - INFO - vrouter 2024-11-08 14:20:50,155 - INFO - vrouter-nodemgr:active 2024-11-08 14:20:50,162 - INFO - agent:active 2024-11-08 14:20:50,162 - INFO - control 2024-11-08 14:20:50,169 - INFO - control-nodemgr:active 2024-11-08 14:20:50,179 - INFO - control:active 2024-11-08 14:20:50,179 - INFO - named:active 2024-11-08 14:20:50,187 - INFO - dns:active 2024-11-08 14:20:50,187 - INFO - analytics 2024-11-08 14:20:50,193 - INFO - analytics-nodemgr:active 2024-11-08 14:20:50,198 - INFO - analytics-api:active 2024-11-08 14:20:50,204 - INFO - collector:active 2024-11-08 14:20:50,204 - INFO - analytics-database 2024-11-08 14:20:50,204 - INFO - analytics-cassandra:active 2024-11-08 14:20:50,209 - INFO - analyticsdb-nodemgr:active 2024-11-08 14:20:50,215 - INFO - query-engine:active 2024-11-08 14:20:50,215 - INFO - webui 2024-11-08 14:20:50,215 - INFO - webui:active 2024-11-08 14:20:50,215 - INFO - webui-middleware:active 2024-11-08 14:20:50,215 - INFO - redis:active 2024-11-08 14:20:50,215 - INFO - analytics_snmp 2024-11-08 14:20:50,220 - INFO - snmp-collector:active 2024-11-08 14:20:50,220 - INFO - snmp-topology:active 2024-11-08 14:20:50,220 - INFO - analytics_alarm 2024-11-08 14:20:50,220 - INFO - alarmgen:active 2024-11-08 14:20:50,220 - DEBUG - defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:20:50,220 - ERROR - Not all services up , Gave up! 2024-11-08 14:20:50,220 - INFO - Failed services are : defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:20:50,220 - ERROR - contrail-status failed 2024-11-08 14:20:50,344 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:20:50,351 - DEBUG - No XMPP flaps were noticed during the test 2024-11-08 14:20:50,351 - INFO -
2024-11-08 14:20:50,351 - INFO - END TEST : test_contrail_status : FAILED[0:00:41]
2024-11-08 14:20:50,351 - INFO - -------------------------------------------------------------------------------- 2024-11-08 14:20:52,795 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:20:55,255 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-59119891:ctest-vn22-31434163:ctest-vn22-31434163 2024-11-08 14:20:55,262 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-59119891:ctest-vn22-31434163:ctest-vn22-31434163 2024-11-08 14:20:55,268 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-59119891:ctest-vn22-31434163:ctest-vn22-31434163 2024-11-08 14:21:16,513 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-59119891:ctest-vn22-31434163 2024-11-08 14:21:16,518 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-59119891:ctest-vn22-31434163:ctest-vn22-31434163 2024-11-08 14:21:16,524 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-59119891:ctest-vn22-31434163:ctest-vn22-31434163 2024-11-08 14:21:16,660 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:21:20,223 - INFO - admin user already present 2024-11-08 14:21:21,113 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:21:23,297 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-fvn-54007639:ctest-fvn-54007639 2024-11-08 14:21:23,302 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-fvn-54007639:ctest-fvn-54007639 2024-11-08 14:21:23,308 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-fvn-54007639:ctest-fvn-54007639 2024-11-08 14:21:24,310 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-vn1-03846681:ctest-vn1-03846681 2024-11-08 14:21:24,316 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-vn1-03846681:ctest-vn1-03846681 2024-11-08 14:21:24,321 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-vn1-03846681:ctest-vn1-03846681 2024-11-08 14:21:28,244 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:aa9f9c9a-459e-44db-8e3c-e0cf7abac91f 2024-11-08 14:21:28,254 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-vn1-03846681:ctest-vn1-03846681 2024-11-08 14:21:28,267 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:aa9f9c9a-459e-44db-8e3c-e0cf7abac91f 2024-11-08 14:21:38,371 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7866db8b-01c9-45f3-98ca-ddfd28cb5a8e 2024-11-08 14:21:38,379 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-fvn-54007639:ctest-fvn-54007639 2024-11-08 14:21:38,387 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7866db8b-01c9-45f3-98ca-ddfd28cb5a8e 2024-11-08 14:21:39,938 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:aa9f9c9a-459e-44db-8e3c-e0cf7abac91f 2024-11-08 14:21:39,944 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-fvn-54007639 2024-11-08 14:21:39,950 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-fvn-54007639:ctest-fvn-54007639 2024-11-08 14:21:39,956 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=3 2024-11-08 14:21:45,651 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-vn1-03846681 2024-11-08 14:21:45,657 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-vn1-03846681:ctest-vn1-03846681 2024-11-08 14:21:45,663 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-vn1-03846681:ctest-vn1-03846681 2024-11-08 14:21:45,958 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-fvn-54007639 2024-11-08 14:21:45,964 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-fvn-54007639:ctest-fvn-54007639 2024-11-08 14:21:45,969 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-67608640:ctest-fvn-54007639:ctest-fvn-54007639 2024-11-08 14:21:46,234 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:21:49,682 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:21:50,071 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:21:53,679 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:22:05,240 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4fd6e94d-6e08-4744-8698-772194068a6a 2024-11-08 14:22:05,247 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-97773332:ctest-vn-55928667:ctest-vn-55928667 2024-11-08 14:22:05,252 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4fd6e94d-6e08-4744-8698-772194068a6a 2024-11-08 14:22:11,204 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c5b88e15-dd80-4ed0-bb65-3edeeb3cde59 2024-11-08 14:22:11,211 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-97773332:ctest-ext_vn-58825988:ctest-ext_vn-58825988 2024-11-08 14:22:11,216 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c5b88e15-dd80-4ed0-bb65-3edeeb3cde59 2024-11-08 14:22:19,403 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:22:22,854 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:22:26,691 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-70319165:ctest-vn-70319165 2024-11-08 14:22:26,697 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-70319165:ctest-vn-70319165 2024-11-08 14:22:26,703 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-70319165:ctest-vn-70319165 2024-11-08 14:22:27,118 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-82695003:ctest-vn-82695003 2024-11-08 14:22:27,124 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-82695003:ctest-vn-82695003 2024-11-08 14:22:27,129 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-82695003:ctest-vn-82695003 2024-11-08 14:22:27,747 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-82695003 2024-11-08 14:22:27,752 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-82695003:ctest-vn-82695003 2024-11-08 14:22:27,758 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-82695003:ctest-vn-82695003 2024-11-08 14:22:28,035 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-70319165 2024-11-08 14:22:28,041 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-70319165:ctest-vn-70319165 2024-11-08 14:22:28,046 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-63744081:ctest-vn-70319165:ctest-vn-70319165 2024-11-08 14:22:28,311 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:22:31,762 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:22:35,539 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-52350203:ctest-vn-52350203 2024-11-08 14:22:35,545 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-52350203:ctest-vn-52350203 2024-11-08 14:22:35,550 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-52350203:ctest-vn-52350203 2024-11-08 14:22:35,943 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-32824439:ctest-vn-32824439 2024-11-08 14:22:35,950 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-32824439:ctest-vn-32824439 2024-11-08 14:22:35,956 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-32824439:ctest-vn-32824439 2024-11-08 14:22:43,840 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:037bfb5d-7d23-4bd4-9059-0dafe27b3cd7 2024-11-08 14:22:43,847 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-52350203:ctest-vn-52350203 2024-11-08 14:22:43,854 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:037bfb5d-7d23-4bd4-9059-0dafe27b3cd7 2024-11-08 14:22:49,837 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b29cd5ec-7894-48b1-9596-2f60f3ca1208 2024-11-08 14:22:49,847 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-32824439:ctest-vn-32824439 2024-11-08 14:22:49,855 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b29cd5ec-7894-48b1-9596-2f60f3ca1208 2024-11-08 14:23:01,660 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-32824439 2024-11-08 14:23:01,666 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-32824439:ctest-vn-32824439 2024-11-08 14:23:01,673 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-32824439:ctest-vn-32824439 2024-11-08 14:23:01,969 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-52350203 2024-11-08 14:23:01,976 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-52350203:ctest-vn-52350203 2024-11-08 14:23:01,982 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-54342304:ctest-vn-52350203:ctest-vn-52350203 2024-11-08 14:23:02,251 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:23:05,768 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:23:07,828 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083:ctest-mgmt_vn-87266083 2024-11-08 14:23:07,834 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083:ctest-mgmt_vn-87266083 2024-11-08 14:23:07,840 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083:ctest-mgmt_vn-87266083 2024-11-08 14:23:08,963 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107:ctest-left_vn-54228107 2024-11-08 14:23:08,970 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107:ctest-left_vn-54228107 2024-11-08 14:23:08,976 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107:ctest-left_vn-54228107 2024-11-08 14:23:09,972 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062:ctest-right_vn-95936062 2024-11-08 14:23:09,980 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062:ctest-right_vn-95936062 2024-11-08 14:23:09,986 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062:ctest-right_vn-95936062 2024-11-08 14:23:20,754 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:29362053-d4e9-4f8d-a5c6-ab93e4018955 2024-11-08 14:23:20,765 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083:ctest-mgmt_vn-87266083 2024-11-08 14:23:20,770 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fac028d5-4dba-48fe-8df1-df476616e110 2024-11-08 14:23:20,777 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107:ctest-left_vn-54228107 2024-11-08 14:23:20,783 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:793b32ed-21a5-4d08-a7b8-1e3c5216dde3 2024-11-08 14:23:20,789 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062:ctest-right_vn-95936062 2024-11-08 14:23:20,795 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:29362053-d4e9-4f8d-a5c6-ab93e4018955 2024-11-08 14:23:20,801 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:793b32ed-21a5-4d08-a7b8-1e3c5216dde3 2024-11-08 14:23:20,807 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fac028d5-4dba-48fe-8df1-df476616e110 2024-11-08 14:23:54,192 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:166a43f6-e6b5-4141-8d0a-61270f238594 2024-11-08 14:23:54,200 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107:ctest-left_vn-54228107 2024-11-08 14:23:54,206 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:166a43f6-e6b5-4141-8d0a-61270f238594 2024-11-08 14:23:56,058 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0f6fcfab-7062-470d-a748-4e1ef290ebec 2024-11-08 14:23:56,064 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062:ctest-right_vn-95936062 2024-11-08 14:23:56,071 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0f6fcfab-7062-470d-a748-4e1ef290ebec 2024-11-08 14:24:01,020 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:29362053-d4e9-4f8d-a5c6-ab93e4018955 2024-11-08 14:24:01,027 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:793b32ed-21a5-4d08-a7b8-1e3c5216dde3 2024-11-08 14:24:01,033 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fac028d5-4dba-48fe-8df1-df476616e110 2024-11-08 14:24:02,280 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107 2024-11-08 14:24:02,288 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fac028d5-4dba-48fe-8df1-df476616e110 2024-11-08 14:24:02,295 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-11-08 14:24:02,305 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107:ctest-left_vn-54228107 2024-11-08 14:24:02,471 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=2 2024-11-08 14:24:02,695 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Layer2RouteReq?x=2 2024-11-08 14:24:02,710 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107 2024-11-08 14:24:02,717 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107:ctest-left_vn-54228107 2024-11-08 14:24:02,923 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=2 2024-11-08 14:24:03,143 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Layer2RouteReq?x=2 2024-11-08 14:24:03,157 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083 2024-11-08 14:24:03,163 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:29362053-d4e9-4f8d-a5c6-ab93e4018955 2024-11-08 14:24:03,170 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-11-08 14:24:03,179 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083:ctest-mgmt_vn-87266083 2024-11-08 14:24:03,351 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=4 2024-11-08 14:24:03,567 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Layer2RouteReq?x=4 2024-11-08 14:24:03,581 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083 2024-11-08 14:24:03,588 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083:ctest-mgmt_vn-87266083 2024-11-08 14:24:03,795 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=4 2024-11-08 14:24:04,011 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Layer2RouteReq?x=4 2024-11-08 14:24:04,023 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062 2024-11-08 14:24:04,029 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:793b32ed-21a5-4d08-a7b8-1e3c5216dde3 2024-11-08 14:24:04,036 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-11-08 14:24:04,045 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062:ctest-right_vn-95936062 2024-11-08 14:24:04,215 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=3 2024-11-08 14:24:04,435 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Layer2RouteReq?x=3 2024-11-08 14:24:04,449 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062 2024-11-08 14:24:04,456 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062:ctest-right_vn-95936062 2024-11-08 14:24:04,663 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=3 2024-11-08 14:24:04,883 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Layer2RouteReq?x=3 2024-11-08 14:24:05,451 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name= 2024-11-08 14:24:05,458 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=5 2024-11-08 14:24:05,466 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fac028d5-4dba-48fe-8df1-df476616e110 2024-11-08 14:24:05,631 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name= 2024-11-08 14:24:05,639 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_Inet4UcRouteReq?x=6 2024-11-08 14:24:05,648 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:793b32ed-21a5-4d08-a7b8-1e3c5216dde3 2024-11-08 14:24:13,096 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062 2024-11-08 14:24:13,102 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062:ctest-right_vn-95936062 2024-11-08 14:24:13,108 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-right_vn-95936062:ctest-right_vn-95936062 2024-11-08 14:24:13,403 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107 2024-11-08 14:24:13,408 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107:ctest-left_vn-54228107 2024-11-08 14:24:13,413 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-left_vn-54228107:ctest-left_vn-54228107 2024-11-08 14:24:13,700 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083 2024-11-08 14:24:13,706 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083:ctest-mgmt_vn-87266083 2024-11-08 14:24:13,712 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-73399061:ctest-mgmt_vn-87266083:ctest-mgmt_vn-87266083 2024-11-08 14:24:13,990 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:24:18,067 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:24:27,023 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:aa66c4c3-ac83-4daf-a69d-7d4964d4032d 2024-11-08 14:24:27,032 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestvDNSBasic0-36900354:ctest-vn1-vdns-08145601:ctest-vn1-vdns-08145601 2024-11-08 14:24:27,041 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:aa66c4c3-ac83-4daf-a69d-7d4964d4032d 2024-11-08 14:24:36,947 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_DnsInfo? 2024-11-08 14:24:43,556 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:40dd7202-cfc8-4734-bbe3-f617897e3705 2024-11-08 14:24:43,563 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestvDNSBasic0-36900354:ctest-vn1-vdns-08145601:ctest-vn1-vdns-08145601 2024-11-08 14:24:43,568 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:40dd7202-cfc8-4734-bbe3-f617897e3705 2024-11-08 14:24:52,416 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_DnsInfo? 2024-11-08 14:25:03,551 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:25:07,167 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:25:16,333 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:94db6a08-80b7-4bd1-964c-d5c4b88cced1 2024-11-08 14:25:16,341 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVNx-87506536:ctest-vn-38580220:ctest-vn-38580220 2024-11-08 14:25:16,348 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:94db6a08-80b7-4bd1-964c-d5c4b88cced1 2024-11-08 14:25:22,370 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5c014233-5b5d-4d80-9caf-2e75ac09405a 2024-11-08 14:25:22,378 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVNx-87506536:ctest-vn-38580220:ctest-vn-38580220 2024-11-08 14:25:22,384 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5c014233-5b5d-4d80-9caf-2e75ac09405a 2024-11-08 14:25:31,127 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:25:34,759 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:25:42,185 - DEBUG - [10.0.0.65]: Running cmd : docker exec --privileged -it vrouter_vrouter-agent_1 /bin/bash -c 'echo "10.20.0.29 cn-jenkins-deploy-platform-ansible-os-2229-1-test" >> /etc/hosts' 2024-11-08 14:25:42,302 - DEBUG - Output : 2024-11-08 14:25:42,842 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bfbe153a-fc90-40b8-9ec2-dcfbc9dec4e4 2024-11-08 14:25:42,849 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-39163498:ctest-vn2_metadata-90534360:ctest-vn2_metadata-90534360 2024-11-08 14:25:42,854 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:bfbe153a-fc90-40b8-9ec2-dcfbc9dec4e4 2024-11-08 14:25:50,130 - DEBUG - [10.0.0.65]: Running cmd : docker exec --privileged -it vrouter_vrouter-agent_1 /bin/bash -c 'sed -i '$ d' /etc/hosts' 2024-11-08 14:25:50,281 - DEBUG - Output : sed: -e expression #1, char 1: missing command 2024-11-08 14:25:52,898 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:25:53,195 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:25:58,179 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-39163498:ctest-vn-92096805:ctest-vn-92096805 2024-11-08 14:25:58,581 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3203e568-3be9-4176-a457-17df9dda5473 2024-11-08 14:25:58,589 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-39163498:ctest-vn-92096805:ctest-vn-92096805 2024-11-08 14:25:58,597 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3203e568-3be9-4176-a457-17df9dda5473 2024-11-08 14:26:08,762 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a1e0035a-2a8b-4791-a40a-527b79bd4562 2024-11-08 14:26:08,769 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-39163498:ctest-vn-92096805:ctest-vn-92096805 2024-11-08 14:26:08,775 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a1e0035a-2a8b-4791-a40a-527b79bd4562 2024-11-08 14:26:10,617 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:631be9d2-eaee-4f61-aeac-de38bf4c19a1 2024-11-08 14:26:10,623 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-39163498:ctest-vn-92096805:ctest-vn-92096805 2024-11-08 14:26:10,632 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:631be9d2-eaee-4f61-aeac-de38bf4c19a1 2024-11-08 14:26:30,412 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-39163498:ctest-vn-92096805 2024-11-08 14:26:30,419 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-39163498:ctest-vn-92096805:ctest-vn-92096805 2024-11-08 14:26:30,424 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name= 2024-11-08 14:26:30,431 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_KRouteReq?x=2 2024-11-08 14:26:30,436 - DEBUG - Unable to fetch route details in vrouter for vrf index 2, Got :[] 2024-11-08 14:26:30,806 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq? 2024-11-08 14:26:38,437 - DEBUG - [10.0.0.65]: Running cmd : hostname 2024-11-08 14:26:38,967 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2229-1 2024-11-08 14:26:38,967 - DEBUG - [10.0.0.65]: Running cmd : hostname -f 2024-11-08 14:26:39,026 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2229-1. 2024-11-08 14:26:39,026 - DEBUG - [10.0.0.65]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-11-08 14:26:39,163 - DEBUG - Output : NAMES contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:26:39,164 - DEBUG - [10.0.0.65]: Running cmd : getent hosts 10.0.0.65 | head -n 1 | awk '{print $2}' 2024-11-08 14:26:39,218 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2229-1. 2024-11-08 14:26:39,218 - DEBUG - [10.0.0.65]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-11-08 14:26:39,283 - DEBUG - Output : 10.0.0.65/24 172.17.0.1/16 10.20.0.29/24 2024-11-08 14:26:39,283 - DEBUG - [10.0.0.65]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-11-08 14:26:39,350 - DEBUG - Output : 10.20.0.29/24 2024-11-08 14:26:39,350 - DEBUG - [10.0.0.65]: Running cmd : getent hosts 10.20.0.29 | head -n 1 | awk '{print $2}' 2024-11-08 14:26:39,418 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2229-1-test 2024-11-08 14:26:40,249 - DEBUG - Not creating keypair since it exists 2024-11-08 14:26:40,626 - INFO - Using existing project ['default-domain', 'admin'](83f464b6-3148-494c-acad-7a79684e5786) 2024-11-08 14:26:40,812 - INFO - ================================================================================ 2024-11-08 14:26:40,812 - INFO - STARTING TEST : test_contrail_status 2024-11-08 14:26:40,813 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2024-11-08 14:26:40,936 - DEBUG - Skipping xmpp flap check 2024-11-08 14:26:40,936 - INFO - Initial checks done. Running the testcase now 2024-11-08 14:26:40,936 - INFO - 2024-11-08 14:26:40,937 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-11-08 14:26:41,064 - DEBUG - Output : contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:26:41,064 - INFO - 10.0.0.65 2024-11-08 14:26:41,065 - INFO - config 2024-11-08 14:26:41,073 - INFO - config-nodemgr:active 2024-11-08 14:26:41,079 - INFO - api-server:active 2024-11-08 14:26:41,085 - INFO - schema:active 2024-11-08 14:26:41,090 - INFO - svc-monitor:active 2024-11-08 14:26:41,090 - INFO - device-manager:inactive 2024-11-08 14:26:41,090 - INFO - config-database 2024-11-08 14:26:41,090 - INFO - config-cassandra:active 2024-11-08 14:26:41,090 - INFO - config-zookeeper:active 2024-11-08 14:26:41,090 - INFO - config-rabbitmq:active 2024-11-08 14:26:41,090 - INFO - vrouter 2024-11-08 14:26:41,097 - INFO - vrouter-nodemgr:active 2024-11-08 14:26:41,103 - INFO - agent:active 2024-11-08 14:26:41,104 - INFO - control 2024-11-08 14:26:41,110 - INFO - control-nodemgr:active 2024-11-08 14:26:41,116 - INFO - control:active 2024-11-08 14:26:41,116 - INFO - named:active 2024-11-08 14:26:41,125 - INFO - dns:active 2024-11-08 14:26:41,125 - INFO - analytics 2024-11-08 14:26:41,131 - INFO - analytics-nodemgr:active 2024-11-08 14:26:41,136 - INFO - analytics-api:active 2024-11-08 14:26:41,142 - INFO - collector:active 2024-11-08 14:26:41,142 - INFO - analytics-database 2024-11-08 14:26:41,142 - INFO - analytics-cassandra:active 2024-11-08 14:26:41,148 - INFO - analyticsdb-nodemgr:active 2024-11-08 14:26:41,155 - INFO - query-engine:active 2024-11-08 14:26:41,155 - INFO - webui 2024-11-08 14:26:41,155 - INFO - webui:active 2024-11-08 14:26:41,155 - INFO - webui-middleware:active 2024-11-08 14:26:41,156 - INFO - redis:active 2024-11-08 14:26:41,156 - INFO - analytics_snmp 2024-11-08 14:26:41,160 - INFO - snmp-collector:active 2024-11-08 14:26:41,161 - INFO - snmp-topology:active 2024-11-08 14:26:41,161 - INFO - analytics_alarm 2024-11-08 14:26:41,161 - INFO - alarmgen:active 2024-11-08 14:26:41,161 - DEBUG - defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:26:41,161 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 0 2024-11-08 14:26:51,162 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-11-08 14:26:51,237 - DEBUG - Output : contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:26:51,237 - INFO - 10.0.0.65 2024-11-08 14:26:51,237 - INFO - config 2024-11-08 14:26:51,243 - INFO - config-nodemgr:active 2024-11-08 14:26:51,247 - INFO - api-server:active 2024-11-08 14:26:51,252 - INFO - schema:active 2024-11-08 14:26:51,257 - INFO - svc-monitor:active 2024-11-08 14:26:51,257 - INFO - device-manager:inactive 2024-11-08 14:26:51,257 - INFO - config-database 2024-11-08 14:26:51,257 - INFO - config-cassandra:active 2024-11-08 14:26:51,257 - INFO - config-zookeeper:active 2024-11-08 14:26:51,257 - INFO - config-rabbitmq:active 2024-11-08 14:26:51,257 - INFO - vrouter 2024-11-08 14:26:51,262 - INFO - vrouter-nodemgr:active 2024-11-08 14:26:51,268 - INFO - agent:active 2024-11-08 14:26:51,268 - INFO - control 2024-11-08 14:26:51,274 - INFO - control-nodemgr:active 2024-11-08 14:26:51,280 - INFO - control:active 2024-11-08 14:26:51,280 - INFO - named:active 2024-11-08 14:26:51,286 - INFO - dns:active 2024-11-08 14:26:51,286 - INFO - analytics 2024-11-08 14:26:51,291 - INFO - analytics-nodemgr:active 2024-11-08 14:26:51,296 - INFO - analytics-api:active 2024-11-08 14:26:51,301 - INFO - collector:active 2024-11-08 14:26:51,301 - INFO - analytics-database 2024-11-08 14:26:51,301 - INFO - analytics-cassandra:active 2024-11-08 14:26:51,308 - INFO - analyticsdb-nodemgr:active 2024-11-08 14:26:51,315 - INFO - query-engine:active 2024-11-08 14:26:51,315 - INFO - webui 2024-11-08 14:26:51,315 - INFO - webui:active 2024-11-08 14:26:51,315 - INFO - webui-middleware:active 2024-11-08 14:26:51,315 - INFO - redis:active 2024-11-08 14:26:51,315 - INFO - analytics_snmp 2024-11-08 14:26:51,320 - INFO - snmp-collector:active 2024-11-08 14:26:51,320 - INFO - snmp-topology:active 2024-11-08 14:26:51,320 - INFO - analytics_alarm 2024-11-08 14:26:51,320 - INFO - alarmgen:active 2024-11-08 14:26:51,320 - DEBUG - defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:26:51,320 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 1 2024-11-08 14:27:01,321 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-11-08 14:27:01,396 - DEBUG - Output : contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:27:01,396 - INFO - 10.0.0.65 2024-11-08 14:27:01,396 - INFO - config 2024-11-08 14:27:01,403 - INFO - config-nodemgr:active 2024-11-08 14:27:01,407 - INFO - api-server:active 2024-11-08 14:27:01,412 - INFO - schema:active 2024-11-08 14:27:01,416 - INFO - svc-monitor:active 2024-11-08 14:27:01,417 - INFO - device-manager:inactive 2024-11-08 14:27:01,417 - INFO - config-database 2024-11-08 14:27:01,417 - INFO - config-cassandra:active 2024-11-08 14:27:01,417 - INFO - config-zookeeper:active 2024-11-08 14:27:01,417 - INFO - config-rabbitmq:active 2024-11-08 14:27:01,417 - INFO - vrouter 2024-11-08 14:27:01,422 - INFO - vrouter-nodemgr:active 2024-11-08 14:27:01,429 - INFO - agent:active 2024-11-08 14:27:01,429 - INFO - control 2024-11-08 14:27:01,436 - INFO - control-nodemgr:active 2024-11-08 14:27:01,443 - INFO - control:active 2024-11-08 14:27:01,443 - INFO - named:active 2024-11-08 14:27:01,453 - INFO - dns:active 2024-11-08 14:27:01,454 - INFO - analytics 2024-11-08 14:27:01,460 - INFO - analytics-nodemgr:active 2024-11-08 14:27:01,465 - INFO - analytics-api:active 2024-11-08 14:27:01,472 - INFO - collector:active 2024-11-08 14:27:01,472 - INFO - analytics-database 2024-11-08 14:27:01,472 - INFO - analytics-cassandra:active 2024-11-08 14:27:01,478 - INFO - analyticsdb-nodemgr:active 2024-11-08 14:27:01,483 - INFO - query-engine:active 2024-11-08 14:27:01,484 - INFO - webui 2024-11-08 14:27:01,484 - INFO - webui:active 2024-11-08 14:27:01,484 - INFO - webui-middleware:active 2024-11-08 14:27:01,484 - INFO - redis:active 2024-11-08 14:27:01,484 - INFO - analytics_snmp 2024-11-08 14:27:01,488 - INFO - snmp-collector:active 2024-11-08 14:27:01,488 - INFO - snmp-topology:active 2024-11-08 14:27:01,488 - INFO - analytics_alarm 2024-11-08 14:27:01,488 - INFO - alarmgen:active 2024-11-08 14:27:01,488 - DEBUG - defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:27:01,488 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 2 2024-11-08 14:27:11,489 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-11-08 14:27:11,575 - DEBUG - Output : contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:27:11,575 - INFO - 10.0.0.65 2024-11-08 14:27:11,575 - INFO - config 2024-11-08 14:27:11,581 - INFO - config-nodemgr:active 2024-11-08 14:27:11,585 - INFO - api-server:active 2024-11-08 14:27:11,591 - INFO - schema:active 2024-11-08 14:27:11,597 - INFO - svc-monitor:active 2024-11-08 14:27:11,597 - INFO - device-manager:inactive 2024-11-08 14:27:11,597 - INFO - config-database 2024-11-08 14:27:11,597 - INFO - config-cassandra:active 2024-11-08 14:27:11,597 - INFO - config-zookeeper:active 2024-11-08 14:27:11,597 - INFO - config-rabbitmq:active 2024-11-08 14:27:11,598 - INFO - vrouter 2024-11-08 14:27:11,605 - INFO - vrouter-nodemgr:active 2024-11-08 14:27:11,611 - INFO - agent:active 2024-11-08 14:27:11,612 - INFO - control 2024-11-08 14:27:11,618 - INFO - control-nodemgr:active 2024-11-08 14:27:11,626 - INFO - control:active 2024-11-08 14:27:11,626 - INFO - named:active 2024-11-08 14:27:11,634 - INFO - dns:active 2024-11-08 14:27:11,634 - INFO - analytics 2024-11-08 14:27:11,640 - INFO - analytics-nodemgr:active 2024-11-08 14:27:11,645 - INFO - analytics-api:active 2024-11-08 14:27:11,651 - INFO - collector:active 2024-11-08 14:27:11,651 - INFO - analytics-database 2024-11-08 14:27:11,651 - INFO - analytics-cassandra:active 2024-11-08 14:27:11,656 - INFO - analyticsdb-nodemgr:active 2024-11-08 14:27:11,662 - INFO - query-engine:active 2024-11-08 14:27:11,662 - INFO - webui 2024-11-08 14:27:11,662 - INFO - webui:active 2024-11-08 14:27:11,662 - INFO - webui-middleware:active 2024-11-08 14:27:11,662 - INFO - redis:active 2024-11-08 14:27:11,663 - INFO - analytics_snmp 2024-11-08 14:27:11,668 - INFO - snmp-collector:active 2024-11-08 14:27:11,668 - INFO - snmp-topology:active 2024-11-08 14:27:11,669 - INFO - analytics_alarm 2024-11-08 14:27:11,669 - INFO - alarmgen:active 2024-11-08 14:27:11,669 - DEBUG - defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:27:11,669 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 3 2024-11-08 14:27:21,670 - DEBUG - [10.0.0.65]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-11-08 14:27:21,746 - DEBUG - Output : contrail_test_iXDr4cEHW vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_collector_1 analytics_api_1 analytics_provisioner_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_schema_1 config_dnsmasq_1 config_api_1 config_nodemgr_1 config_svcmonitor_1 config_provisioner_1 config_database_rabbitmq_1 config_database_nodemgr_1 config_database_provisioner_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-11-08 14:27:21,746 - INFO - 10.0.0.65 2024-11-08 14:27:21,746 - INFO - config 2024-11-08 14:27:21,752 - INFO - config-nodemgr:active 2024-11-08 14:27:21,757 - INFO - api-server:active 2024-11-08 14:27:21,761 - INFO - schema:active 2024-11-08 14:27:21,765 - INFO - svc-monitor:active 2024-11-08 14:27:21,765 - INFO - device-manager:inactive 2024-11-08 14:27:21,765 - INFO - config-database 2024-11-08 14:27:21,765 - INFO - config-cassandra:active 2024-11-08 14:27:21,765 - INFO - config-zookeeper:active 2024-11-08 14:27:21,765 - INFO - config-rabbitmq:active 2024-11-08 14:27:21,765 - INFO - vrouter 2024-11-08 14:27:21,770 - INFO - vrouter-nodemgr:active 2024-11-08 14:27:21,776 - INFO - agent:active 2024-11-08 14:27:21,776 - INFO - control 2024-11-08 14:27:21,781 - INFO - control-nodemgr:active 2024-11-08 14:27:21,788 - INFO - control:active 2024-11-08 14:27:21,788 - INFO - named:active 2024-11-08 14:27:21,793 - INFO - dns:active 2024-11-08 14:27:21,794 - INFO - analytics 2024-11-08 14:27:21,800 - INFO - analytics-nodemgr:active 2024-11-08 14:27:21,805 - INFO - analytics-api:active 2024-11-08 14:27:21,814 - INFO - collector:active 2024-11-08 14:27:21,814 - INFO - analytics-database 2024-11-08 14:27:21,814 - INFO - analytics-cassandra:active 2024-11-08 14:27:21,819 - INFO - analyticsdb-nodemgr:active 2024-11-08 14:27:21,826 - INFO - query-engine:active 2024-11-08 14:27:21,826 - INFO - webui 2024-11-08 14:27:21,826 - INFO - webui:active 2024-11-08 14:27:21,826 - INFO - webui-middleware:active 2024-11-08 14:27:21,826 - INFO - redis:active 2024-11-08 14:27:21,826 - INFO - analytics_snmp 2024-11-08 14:27:21,831 - INFO - snmp-collector:active 2024-11-08 14:27:21,831 - INFO - snmp-topology:active 2024-11-08 14:27:21,831 - INFO - analytics_alarm 2024-11-08 14:27:21,831 - INFO - alarmgen:active 2024-11-08 14:27:21,832 - DEBUG - defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:27:21,832 - ERROR - Not all services up , Gave up! 2024-11-08 14:27:21,832 - INFO - Failed services are : defaultdict(, {'10.0.0.65': {'device-manager': {'status': 'inactive', 'description': None}}}) 2024-11-08 14:27:21,832 - ERROR - contrail-status failed 2024-11-08 14:27:21,956 - DEBUG - Skipping xmpp flap check 2024-11-08 14:27:21,956 - INFO -
2024-11-08 14:27:21,956 - INFO - END TEST : test_contrail_status : FAILED[0:00:41]
2024-11-08 14:27:21,956 - INFO - --------------------------------------------------------------------------------