2024-10-25 15:18:02,025 - DEBUG - [10.0.0.31]: Running cmd : hostname 2024-10-25 15:18:02,219 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2145-1 2024-10-25 15:18:02,219 - DEBUG - [10.0.0.31]: Running cmd : hostname -f 2024-10-25 15:18:02,284 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2145-1. 2024-10-25 15:18:02,284 - DEBUG - [10.0.0.31]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-10-25 15:18:02,424 - DEBUG - Output : NAMES contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_alarm-gen_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_svcmonitor_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:18:02,424 - DEBUG - [10.0.0.31]: Running cmd : getent hosts 10.0.0.31 | head -n 1 | awk '{print $2}' 2024-10-25 15:18:02,494 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2145-1. 2024-10-25 15:18:02,495 - DEBUG - [10.0.0.31]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-10-25 15:18:02,555 - DEBUG - Output : 10.0.0.31/24 172.17.0.1/16 10.20.0.14/24 2024-10-25 15:18:02,581 - DEBUG - [10.0.0.31]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-10-25 15:18:02,635 - DEBUG - Output : 10.20.0.14/24 2024-10-25 15:18:02,635 - DEBUG - [10.0.0.31]: Running cmd : getent hosts 10.20.0.14 | head -n 1 | awk '{print $2}' 2024-10-25 15:18:02,691 - DEBUG - Output : 2024-10-25 15:18:04,586 - INFO - Using existing project ['default-domain', 'admin'](471f485c-cd62-499a-bba7-ef8b3bb50025) 2024-10-25 15:18:04,786 - INFO - ================================================================================ 2024-10-25 15:18:04,786 - INFO - STARTING TEST : test_contrail_status 2024-10-25 15:18:04,787 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2024-10-25 15:18:04,923 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:18:04,932 - DEBUG - Nothing to compare xmpp stats {'10.0.0.31': {'10.20.0.14': '0'}} with 2024-10-25 15:18:04,932 - INFO - Initial checks done. Running the testcase now 2024-10-25 15:18:04,932 - INFO - 2024-10-25 15:18:04,932 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-10-25 15:18:05,055 - DEBUG - Output : contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_provisioner_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:18:05,056 - INFO - 10.0.0.31 2024-10-25 15:18:05,056 - INFO - config 2024-10-25 15:18:05,063 - INFO - config-nodemgr:active 2024-10-25 15:18:05,070 - INFO - api-server:active 2024-10-25 15:18:05,075 - INFO - schema:active 2024-10-25 15:18:05,075 - INFO - svc-monitor:inactive 2024-10-25 15:18:05,080 - INFO - device-manager:active 2024-10-25 15:18:05,080 - INFO - config-database 2024-10-25 15:18:05,081 - INFO - config-cassandra:active 2024-10-25 15:18:05,081 - INFO - config-zookeeper:active 2024-10-25 15:18:05,081 - INFO - config-rabbitmq:active 2024-10-25 15:18:05,081 - INFO - vrouter 2024-10-25 15:18:05,087 - INFO - vrouter-nodemgr:active 2024-10-25 15:18:05,094 - INFO - agent:active 2024-10-25 15:18:05,094 - INFO - control 2024-10-25 15:18:05,101 - INFO - control-nodemgr:active 2024-10-25 15:18:05,107 - INFO - control:active 2024-10-25 15:18:05,108 - INFO - named:active 2024-10-25 15:18:05,114 - INFO - dns:active 2024-10-25 15:18:05,114 - INFO - analytics 2024-10-25 15:18:05,120 - INFO - analytics-nodemgr:active 2024-10-25 15:18:05,126 - INFO - analytics-api:active 2024-10-25 15:18:05,132 - INFO - collector:active 2024-10-25 15:18:05,132 - INFO - analytics-database 2024-10-25 15:18:05,132 - INFO - analytics-cassandra:active 2024-10-25 15:18:05,138 - INFO - analyticsdb-nodemgr:active 2024-10-25 15:18:05,144 - INFO - query-engine:active 2024-10-25 15:18:05,145 - INFO - webui 2024-10-25 15:18:05,145 - INFO - webui:active 2024-10-25 15:18:05,145 - INFO - webui-middleware:active 2024-10-25 15:18:05,145 - INFO - redis:active 2024-10-25 15:18:05,145 - INFO - analytics_snmp 2024-10-25 15:18:05,150 - INFO - snmp-collector:active 2024-10-25 15:18:05,151 - INFO - snmp-topology:active 2024-10-25 15:18:05,151 - INFO - analytics_alarm 2024-10-25 15:18:05,151 - INFO - alarmgen:active 2024-10-25 15:18:05,151 - DEBUG - defaultdict(, {'10.0.0.31': {'svc-monitor': {'status': 'inactive', 'description': None}}}) 2024-10-25 15:18:05,151 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 0 2024-10-25 15:18:15,151 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-10-25 15:18:15,237 - DEBUG - Output : contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_provisioner_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:18:15,238 - INFO - 10.0.0.31 2024-10-25 15:18:15,238 - INFO - config 2024-10-25 15:18:15,245 - INFO - config-nodemgr:active 2024-10-25 15:18:15,251 - INFO - api-server:active 2024-10-25 15:18:15,256 - INFO - schema:active 2024-10-25 15:18:15,256 - INFO - svc-monitor:inactive 2024-10-25 15:18:15,262 - INFO - device-manager:active 2024-10-25 15:18:15,262 - INFO - config-database 2024-10-25 15:18:15,262 - INFO - config-cassandra:active 2024-10-25 15:18:15,262 - INFO - config-zookeeper:active 2024-10-25 15:18:15,262 - INFO - config-rabbitmq:active 2024-10-25 15:18:15,262 - INFO - vrouter 2024-10-25 15:18:15,269 - INFO - vrouter-nodemgr:active 2024-10-25 15:18:15,275 - INFO - agent:active 2024-10-25 15:18:15,275 - INFO - control 2024-10-25 15:18:15,281 - INFO - control-nodemgr:active 2024-10-25 15:18:15,288 - INFO - control:active 2024-10-25 15:18:15,288 - INFO - named:active 2024-10-25 15:18:15,295 - INFO - dns:active 2024-10-25 15:18:15,295 - INFO - analytics 2024-10-25 15:18:15,309 - INFO - analytics-nodemgr:active 2024-10-25 15:18:15,317 - INFO - analytics-api:active 2024-10-25 15:18:15,325 - INFO - collector:active 2024-10-25 15:18:15,325 - INFO - analytics-database 2024-10-25 15:18:15,325 - INFO - analytics-cassandra:active 2024-10-25 15:18:15,333 - INFO - analyticsdb-nodemgr:active 2024-10-25 15:18:15,342 - INFO - query-engine:active 2024-10-25 15:18:15,342 - INFO - webui 2024-10-25 15:18:15,342 - INFO - webui:active 2024-10-25 15:18:15,342 - INFO - webui-middleware:active 2024-10-25 15:18:15,342 - INFO - redis:active 2024-10-25 15:18:15,342 - INFO - analytics_snmp 2024-10-25 15:18:15,348 - INFO - snmp-collector:active 2024-10-25 15:18:15,348 - INFO - snmp-topology:active 2024-10-25 15:18:15,348 - INFO - analytics_alarm 2024-10-25 15:18:15,348 - INFO - alarmgen:active 2024-10-25 15:18:15,349 - DEBUG - defaultdict(, {'10.0.0.31': {'svc-monitor': {'status': 'inactive', 'description': None}}}) 2024-10-25 15:18:15,349 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 1 2024-10-25 15:18:25,349 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-10-25 15:18:25,439 - DEBUG - Output : contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_provisioner_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:18:25,439 - INFO - 10.0.0.31 2024-10-25 15:18:25,439 - INFO - config 2024-10-25 15:18:25,445 - INFO - config-nodemgr:active 2024-10-25 15:18:25,451 - INFO - api-server:active 2024-10-25 15:18:25,456 - INFO - schema:active 2024-10-25 15:18:25,456 - INFO - svc-monitor:inactive 2024-10-25 15:18:25,462 - INFO - device-manager:active 2024-10-25 15:18:25,462 - INFO - config-database 2024-10-25 15:18:25,462 - INFO - config-cassandra:active 2024-10-25 15:18:25,462 - INFO - config-zookeeper:active 2024-10-25 15:18:25,462 - INFO - config-rabbitmq:active 2024-10-25 15:18:25,462 - INFO - vrouter 2024-10-25 15:18:25,468 - INFO - vrouter-nodemgr:active 2024-10-25 15:18:25,474 - INFO - agent:active 2024-10-25 15:18:25,474 - INFO - control 2024-10-25 15:18:25,481 - INFO - control-nodemgr:active 2024-10-25 15:18:25,487 - INFO - control:active 2024-10-25 15:18:25,487 - INFO - named:active 2024-10-25 15:18:25,493 - INFO - dns:active 2024-10-25 15:18:25,493 - INFO - analytics 2024-10-25 15:18:25,499 - INFO - analytics-nodemgr:active 2024-10-25 15:18:25,504 - INFO - analytics-api:active 2024-10-25 15:18:25,511 - INFO - collector:active 2024-10-25 15:18:25,511 - INFO - analytics-database 2024-10-25 15:18:25,511 - INFO - analytics-cassandra:active 2024-10-25 15:18:25,517 - INFO - analyticsdb-nodemgr:active 2024-10-25 15:18:25,523 - INFO - query-engine:active 2024-10-25 15:18:25,523 - INFO - webui 2024-10-25 15:18:25,524 - INFO - webui:active 2024-10-25 15:18:25,524 - INFO - webui-middleware:active 2024-10-25 15:18:25,524 - INFO - redis:active 2024-10-25 15:18:25,524 - INFO - analytics_snmp 2024-10-25 15:18:25,529 - INFO - snmp-collector:active 2024-10-25 15:18:25,529 - INFO - snmp-topology:active 2024-10-25 15:18:25,529 - INFO - analytics_alarm 2024-10-25 15:18:25,529 - INFO - alarmgen:active 2024-10-25 15:18:25,529 - DEBUG - defaultdict(, {'10.0.0.31': {'svc-monitor': {'status': 'inactive', 'description': None}}}) 2024-10-25 15:18:25,529 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 2 2024-10-25 15:18:35,531 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-10-25 15:18:35,618 - DEBUG - Output : contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_provisioner_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:18:35,619 - INFO - 10.0.0.31 2024-10-25 15:18:35,619 - INFO - config 2024-10-25 15:18:35,626 - INFO - config-nodemgr:active 2024-10-25 15:18:35,631 - INFO - api-server:active 2024-10-25 15:18:35,636 - INFO - schema:active 2024-10-25 15:18:35,637 - INFO - svc-monitor:inactive 2024-10-25 15:18:35,644 - INFO - device-manager:active 2024-10-25 15:18:35,644 - INFO - config-database 2024-10-25 15:18:35,644 - INFO - config-cassandra:active 2024-10-25 15:18:35,645 - INFO - config-zookeeper:active 2024-10-25 15:18:35,645 - INFO - config-rabbitmq:active 2024-10-25 15:18:35,645 - INFO - vrouter 2024-10-25 15:18:35,656 - INFO - vrouter-nodemgr:active 2024-10-25 15:18:35,663 - INFO - agent:active 2024-10-25 15:18:35,663 - INFO - control 2024-10-25 15:18:35,669 - INFO - control-nodemgr:active 2024-10-25 15:18:35,675 - INFO - control:active 2024-10-25 15:18:35,676 - INFO - named:active 2024-10-25 15:18:35,682 - INFO - dns:active 2024-10-25 15:18:35,682 - INFO - analytics 2024-10-25 15:18:35,688 - INFO - analytics-nodemgr:active 2024-10-25 15:18:35,694 - INFO - analytics-api:active 2024-10-25 15:18:35,701 - INFO - collector:active 2024-10-25 15:18:35,701 - INFO - analytics-database 2024-10-25 15:18:35,701 - INFO - analytics-cassandra:active 2024-10-25 15:18:35,710 - INFO - analyticsdb-nodemgr:active 2024-10-25 15:18:35,716 - INFO - query-engine:active 2024-10-25 15:18:35,717 - INFO - webui 2024-10-25 15:18:35,717 - INFO - webui:active 2024-10-25 15:18:35,717 - INFO - webui-middleware:active 2024-10-25 15:18:35,717 - INFO - redis:active 2024-10-25 15:18:35,717 - INFO - analytics_snmp 2024-10-25 15:18:35,722 - INFO - snmp-collector:active 2024-10-25 15:18:35,722 - INFO - snmp-topology:active 2024-10-25 15:18:35,723 - INFO - analytics_alarm 2024-10-25 15:18:35,723 - INFO - alarmgen:active 2024-10-25 15:18:35,723 - DEBUG - defaultdict(, {'10.0.0.31': {'svc-monitor': {'status': 'inactive', 'description': None}}}) 2024-10-25 15:18:35,723 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 3 2024-10-25 15:18:45,724 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-10-25 15:18:45,812 - DEBUG - Output : contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_provisioner_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:18:45,812 - INFO - 10.0.0.31 2024-10-25 15:18:45,813 - INFO - config 2024-10-25 15:18:45,820 - INFO - config-nodemgr:active 2024-10-25 15:18:45,827 - INFO - api-server:active 2024-10-25 15:18:45,834 - INFO - schema:active 2024-10-25 15:18:45,834 - INFO - svc-monitor:inactive 2024-10-25 15:18:45,841 - INFO - device-manager:active 2024-10-25 15:18:45,841 - INFO - config-database 2024-10-25 15:18:45,841 - INFO - config-cassandra:active 2024-10-25 15:18:45,841 - INFO - config-zookeeper:active 2024-10-25 15:18:45,841 - INFO - config-rabbitmq:active 2024-10-25 15:18:45,842 - INFO - vrouter 2024-10-25 15:18:45,848 - INFO - vrouter-nodemgr:active 2024-10-25 15:18:45,854 - INFO - agent:active 2024-10-25 15:18:45,854 - INFO - control 2024-10-25 15:18:45,861 - INFO - control-nodemgr:active 2024-10-25 15:18:45,869 - INFO - control:active 2024-10-25 15:18:45,869 - INFO - named:active 2024-10-25 15:18:45,875 - INFO - dns:active 2024-10-25 15:18:45,876 - INFO - analytics 2024-10-25 15:18:45,883 - INFO - analytics-nodemgr:active 2024-10-25 15:18:45,890 - INFO - analytics-api:active 2024-10-25 15:18:45,898 - INFO - collector:active 2024-10-25 15:18:45,898 - INFO - analytics-database 2024-10-25 15:18:45,898 - INFO - analytics-cassandra:active 2024-10-25 15:18:45,905 - INFO - analyticsdb-nodemgr:active 2024-10-25 15:18:45,913 - INFO - query-engine:active 2024-10-25 15:18:45,913 - INFO - webui 2024-10-25 15:18:45,913 - INFO - webui:active 2024-10-25 15:18:45,913 - INFO - webui-middleware:active 2024-10-25 15:18:45,913 - INFO - redis:active 2024-10-25 15:18:45,913 - INFO - analytics_snmp 2024-10-25 15:18:45,919 - INFO - snmp-collector:active 2024-10-25 15:18:45,919 - INFO - snmp-topology:active 2024-10-25 15:18:45,919 - INFO - analytics_alarm 2024-10-25 15:18:45,920 - INFO - alarmgen:active 2024-10-25 15:18:45,920 - DEBUG - defaultdict(, {'10.0.0.31': {'svc-monitor': {'status': 'inactive', 'description': None}}}) 2024-10-25 15:18:45,920 - ERROR - Not all services up , Gave up! 2024-10-25 15:18:45,920 - INFO - Failed services are : defaultdict(, {'10.0.0.31': {'svc-monitor': {'status': 'inactive', 'description': None}}}) 2024-10-25 15:18:45,920 - ERROR - contrail-status failed 2024-10-25 15:18:46,045 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:18:46,052 - DEBUG - No XMPP flaps were noticed during the test 2024-10-25 15:18:46,052 - INFO -
2024-10-25 15:18:46,052 - INFO - END TEST : test_contrail_status : FAILED[0:00:42]
2024-10-25 15:18:46,052 - INFO - -------------------------------------------------------------------------------- 2024-10-25 15:18:48,797 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:18:51,843 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-94857811:ctest-vn22-09361669:ctest-vn22-09361669 2024-10-25 15:18:51,852 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-94857811:ctest-vn22-09361669:ctest-vn22-09361669 2024-10-25 15:18:51,860 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-94857811:ctest-vn22-09361669:ctest-vn22-09361669 2024-10-25 15:19:13,676 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-94857811:ctest-vn22-09361669 2024-10-25 15:19:13,683 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-94857811:ctest-vn22-09361669:ctest-vn22-09361669 2024-10-25 15:19:13,691 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-94857811:ctest-vn22-09361669:ctest-vn22-09361669 2024-10-25 15:19:13,860 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:19:18,058 - INFO - admin user already present 2024-10-25 15:19:19,022 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:19:21,437 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-fvn-61533456:ctest-fvn-61533456 2024-10-25 15:19:21,445 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-fvn-61533456:ctest-fvn-61533456 2024-10-25 15:19:21,452 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-fvn-61533456:ctest-fvn-61533456 2024-10-25 15:19:22,720 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-vn1-30548340:ctest-vn1-30548340 2024-10-25 15:19:22,728 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-vn1-30548340:ctest-vn1-30548340 2024-10-25 15:19:22,735 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-vn1-30548340:ctest-vn1-30548340 2024-10-25 15:19:32,200 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e95b9fcd-1806-4be9-af29-76a962aed8d6 2024-10-25 15:19:32,209 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-vn1-30548340:ctest-vn1-30548340 2024-10-25 15:19:32,216 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e95b9fcd-1806-4be9-af29-76a962aed8d6 2024-10-25 15:19:38,398 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6e9cbfb9-557b-4dc2-94b9-d2b19634d7d0 2024-10-25 15:19:38,406 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-fvn-61533456:ctest-fvn-61533456 2024-10-25 15:19:38,413 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6e9cbfb9-557b-4dc2-94b9-d2b19634d7d0 2024-10-25 15:19:40,014 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e95b9fcd-1806-4be9-af29-76a962aed8d6 2024-10-25 15:19:40,022 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-fvn-61533456 2024-10-25 15:19:40,031 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-fvn-61533456:ctest-fvn-61533456 2024-10-25 15:19:40,038 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Inet4UcRouteReq?x=3 2024-10-25 15:19:45,974 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-vn1-30548340 2024-10-25 15:19:45,980 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-vn1-30548340:ctest-vn1-30548340 2024-10-25 15:19:45,987 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-vn1-30548340:ctest-vn1-30548340 2024-10-25 15:19:46,289 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-fvn-61533456 2024-10-25 15:19:46,296 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-fvn-61533456:ctest-fvn-61533456 2024-10-25 15:19:46,303 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-42592737:ctest-fvn-61533456:ctest-fvn-61533456 2024-10-25 15:19:46,577 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:19:50,606 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:19:51,032 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:19:55,012 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:20:07,716 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:20e895a0-2421-4287-a51b-6986fd04e26e 2024-10-25 15:20:07,723 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-65416611:ctest-vn-10116671:ctest-vn-10116671 2024-10-25 15:20:07,730 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:20e895a0-2421-4287-a51b-6986fd04e26e 2024-10-25 15:20:13,777 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ffbe0d3a-06ea-428b-a3e1-547059c6a8c4 2024-10-25 15:20:13,785 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-65416611:ctest-ext_vn-19084449:ctest-ext_vn-19084449 2024-10-25 15:20:13,791 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ffbe0d3a-06ea-428b-a3e1-547059c6a8c4 2024-10-25 15:21:05,724 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:21:09,688 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:21:14,144 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-23574181:ctest-vn-23574181 2024-10-25 15:21:14,152 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-23574181:ctest-vn-23574181 2024-10-25 15:21:14,159 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-23574181:ctest-vn-23574181 2024-10-25 15:21:14,613 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-37555159:ctest-vn-37555159 2024-10-25 15:21:14,621 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-37555159:ctest-vn-37555159 2024-10-25 15:21:14,628 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-37555159:ctest-vn-37555159 2024-10-25 15:21:15,393 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-37555159 2024-10-25 15:21:15,400 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-37555159:ctest-vn-37555159 2024-10-25 15:21:15,408 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-37555159:ctest-vn-37555159 2024-10-25 15:21:15,861 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-23574181 2024-10-25 15:21:15,867 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-23574181:ctest-vn-23574181 2024-10-25 15:21:15,874 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-65028813:ctest-vn-23574181:ctest-vn-23574181 2024-10-25 15:21:16,143 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:21:19,991 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:21:23,970 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-59290387:ctest-vn-59290387 2024-10-25 15:21:23,978 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-59290387:ctest-vn-59290387 2024-10-25 15:21:23,984 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-59290387:ctest-vn-59290387 2024-10-25 15:21:24,432 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-86761803:ctest-vn-86761803 2024-10-25 15:21:24,440 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-86761803:ctest-vn-86761803 2024-10-25 15:21:24,446 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-86761803:ctest-vn-86761803 2024-10-25 15:21:32,734 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a03ae5bb-3d24-4b7a-bab5-e5eea7cfc1b6 2024-10-25 15:21:32,742 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-59290387:ctest-vn-59290387 2024-10-25 15:21:32,749 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a03ae5bb-3d24-4b7a-bab5-e5eea7cfc1b6 2024-10-25 15:21:44,011 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:228fddeb-1007-4041-ac5c-f792eeef0322 2024-10-25 15:21:44,018 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-86761803:ctest-vn-86761803 2024-10-25 15:21:44,025 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:228fddeb-1007-4041-ac5c-f792eeef0322 2024-10-25 15:21:56,095 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-86761803 2024-10-25 15:21:56,102 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-86761803:ctest-vn-86761803 2024-10-25 15:21:56,109 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-86761803:ctest-vn-86761803 2024-10-25 15:21:56,436 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-59290387 2024-10-25 15:21:56,443 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-59290387:ctest-vn-59290387 2024-10-25 15:21:56,449 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-08013294:ctest-vn-59290387:ctest-vn-59290387 2024-10-25 15:21:56,729 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:22:00,520 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:22:02,910 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399:ctest-mgmt_vn-02141399 2024-10-25 15:22:02,917 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399:ctest-mgmt_vn-02141399 2024-10-25 15:22:02,924 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399:ctest-mgmt_vn-02141399 2024-10-25 15:22:09,740 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856:ctest-left_vn-76866856 2024-10-25 15:22:09,746 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856:ctest-left_vn-76866856 2024-10-25 15:22:09,752 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856:ctest-left_vn-76866856 2024-10-25 15:22:10,912 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898:ctest-right_vn-31067898 2024-10-25 15:22:10,920 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898:ctest-right_vn-31067898 2024-10-25 15:22:10,927 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898:ctest-right_vn-31067898 2024-10-25 15:22:22,442 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:73ddac22-a8b7-4f30-bf23-44a970f9548a 2024-10-25 15:22:22,455 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399:ctest-mgmt_vn-02141399 2024-10-25 15:22:22,464 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2179f041-f4b1-45d2-8b9c-1d68716aedaf 2024-10-25 15:22:22,473 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856:ctest-left_vn-76866856 2024-10-25 15:22:22,481 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cd995a4b-7526-4aca-8095-d768b925eae3 2024-10-25 15:22:22,490 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898:ctest-right_vn-31067898 2024-10-25 15:22:22,497 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2179f041-f4b1-45d2-8b9c-1d68716aedaf 2024-10-25 15:22:22,506 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:73ddac22-a8b7-4f30-bf23-44a970f9548a 2024-10-25 15:22:22,515 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cd995a4b-7526-4aca-8095-d768b925eae3 2024-10-25 15:23:03,372 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:98b3cf04-a1d4-439e-a990-892240b7cccb 2024-10-25 15:23:03,380 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856:ctest-left_vn-76866856 2024-10-25 15:23:03,386 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:98b3cf04-a1d4-439e-a990-892240b7cccb 2024-10-25 15:23:05,284 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:31eec347-4a11-43ed-b0de-414bfc0d8423 2024-10-25 15:23:05,292 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898:ctest-right_vn-31067898 2024-10-25 15:23:05,299 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:31eec347-4a11-43ed-b0de-414bfc0d8423 2024-10-25 15:23:10,289 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2179f041-f4b1-45d2-8b9c-1d68716aedaf 2024-10-25 15:23:10,296 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:73ddac22-a8b7-4f30-bf23-44a970f9548a 2024-10-25 15:23:10,304 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cd995a4b-7526-4aca-8095-d768b925eae3 2024-10-25 15:23:11,557 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856 2024-10-25 15:23:11,565 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2179f041-f4b1-45d2-8b9c-1d68716aedaf 2024-10-25 15:23:11,572 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-25 15:23:11,583 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856:ctest-left_vn-76866856 2024-10-25 15:23:11,748 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Inet4UcRouteReq?x=2 2024-10-25 15:23:11,968 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Layer2RouteReq?x=2 2024-10-25 15:23:11,983 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856 2024-10-25 15:23:11,990 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856:ctest-left_vn-76866856 2024-10-25 15:23:12,200 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Inet4UcRouteReq?x=2 2024-10-25 15:23:12,416 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Layer2RouteReq?x=2 2024-10-25 15:23:12,432 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399 2024-10-25 15:23:12,439 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:73ddac22-a8b7-4f30-bf23-44a970f9548a 2024-10-25 15:23:12,447 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-25 15:23:12,457 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399:ctest-mgmt_vn-02141399 2024-10-25 15:23:12,624 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Inet4UcRouteReq?x=4 2024-10-25 15:23:12,844 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Layer2RouteReq?x=4 2024-10-25 15:23:12,857 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399 2024-10-25 15:23:12,863 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399:ctest-mgmt_vn-02141399 2024-10-25 15:23:13,080 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Inet4UcRouteReq?x=4 2024-10-25 15:23:13,296 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Layer2RouteReq?x=4 2024-10-25 15:23:13,310 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898 2024-10-25 15:23:13,318 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cd995a4b-7526-4aca-8095-d768b925eae3 2024-10-25 15:23:13,325 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-25 15:23:13,338 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898:ctest-right_vn-31067898 2024-10-25 15:23:13,508 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Inet4UcRouteReq?x=3 2024-10-25 15:23:13,729 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Layer2RouteReq?x=3 2024-10-25 15:23:13,746 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898 2024-10-25 15:23:13,755 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898:ctest-right_vn-31067898 2024-10-25 15:23:13,972 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Inet4UcRouteReq?x=3 2024-10-25 15:23:14,196 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_Layer2RouteReq?x=3 2024-10-25 15:24:34,798 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898 2024-10-25 15:24:34,806 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898:ctest-right_vn-31067898 2024-10-25 15:24:34,813 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-right_vn-31067898:ctest-right_vn-31067898 2024-10-25 15:24:35,128 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856 2024-10-25 15:24:35,134 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856:ctest-left_vn-76866856 2024-10-25 15:24:35,140 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-left_vn-76866856:ctest-left_vn-76866856 2024-10-25 15:24:35,439 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399 2024-10-25 15:24:35,446 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399:ctest-mgmt_vn-02141399 2024-10-25 15:24:35,452 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-42593455:ctest-mgmt_vn-02141399:ctest-mgmt_vn-02141399 2024-10-25 15:24:35,720 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:24:39,732 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:24:49,257 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:90cc63b9-dbd6-4dbd-b397-8641c6e5ec4a 2024-10-25 15:24:49,264 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestvDNSBasic0-96335225:ctest-vn1-vdns-14225358:ctest-vn1-vdns-14225358 2024-10-25 15:24:49,271 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:90cc63b9-dbd6-4dbd-b397-8641c6e5ec4a 2024-10-25 15:25:01,678 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_DnsInfo? 2024-10-25 15:25:08,566 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e3ff8cf2-f060-4ade-b242-e59f97658ba1 2024-10-25 15:25:08,574 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestvDNSBasic0-96335225:ctest-vn1-vdns-14225358:ctest-vn1-vdns-14225358 2024-10-25 15:25:08,583 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e3ff8cf2-f060-4ade-b242-e59f97658ba1 2024-10-25 15:25:19,756 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_DnsInfo? 2024-10-25 15:25:31,443 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:25:35,228 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:25:40,059 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:25:43,812 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:25:47,157 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:25:47,470 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:25:53,258 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-48150298:ctest-vn-28459925:ctest-vn-28459925 2024-10-25 15:25:53,265 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-48150298:ctest-vn-28459925:ctest-vn-28459925 2024-10-25 15:25:53,271 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-48150298:ctest-vn-28459925:ctest-vn-28459925 2024-10-25 15:25:54,478 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-48150298:ctest-vn-28459925 2024-10-25 15:25:54,486 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-48150298:ctest-vn-28459925:ctest-vn-28459925 2024-10-25 15:25:54,493 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-48150298:ctest-vn-28459925:ctest-vn-28459925 2024-10-25 15:25:54,891 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-25 15:26:03,664 - DEBUG - [10.0.0.31]: Running cmd : hostname 2024-10-25 15:26:04,237 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2145-1 2024-10-25 15:26:04,237 - DEBUG - [10.0.0.31]: Running cmd : hostname -f 2024-10-25 15:26:04,300 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2145-1. 2024-10-25 15:26:04,300 - DEBUG - [10.0.0.31]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-10-25 15:26:04,446 - DEBUG - Output : NAMES contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_alarm-gen_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_svcmonitor_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:26:04,446 - DEBUG - [10.0.0.31]: Running cmd : getent hosts 10.0.0.31 | head -n 1 | awk '{print $2}' 2024-10-25 15:26:04,507 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-2145-1. 2024-10-25 15:26:04,508 - DEBUG - [10.0.0.31]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-10-25 15:26:04,583 - DEBUG - Output : 10.0.0.31/24 172.17.0.1/16 10.20.0.14/24 2024-10-25 15:26:04,583 - DEBUG - [10.0.0.31]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-10-25 15:26:04,651 - DEBUG - Output : 10.20.0.14/24 2024-10-25 15:26:04,652 - DEBUG - [10.0.0.31]: Running cmd : getent hosts 10.20.0.14 | head -n 1 | awk '{print $2}' 2024-10-25 15:26:04,721 - DEBUG - Output : 2024-10-25 15:26:05,758 - DEBUG - Not creating keypair since it exists 2024-10-25 15:26:06,176 - INFO - Using existing project ['default-domain', 'admin'](471f485c-cd62-499a-bba7-ef8b3bb50025) 2024-10-25 15:26:06,380 - INFO - ================================================================================ 2024-10-25 15:26:06,381 - INFO - STARTING TEST : test_contrail_status 2024-10-25 15:26:06,381 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2024-10-25 15:26:06,506 - DEBUG - Skipping xmpp flap check 2024-10-25 15:26:06,506 - INFO - Initial checks done. Running the testcase now 2024-10-25 15:26:06,506 - INFO - 2024-10-25 15:26:06,506 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-10-25 15:26:06,659 - DEBUG - Output : contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_provisioner_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:26:06,659 - INFO - 10.0.0.31 2024-10-25 15:26:06,660 - INFO - config 2024-10-25 15:26:06,667 - INFO - config-nodemgr:active 2024-10-25 15:26:06,673 - INFO - api-server:active 2024-10-25 15:26:06,678 - INFO - schema:active 2024-10-25 15:26:06,679 - INFO - svc-monitor:inactive 2024-10-25 15:26:06,684 - INFO - device-manager:active 2024-10-25 15:26:06,685 - INFO - config-database 2024-10-25 15:26:06,685 - INFO - config-cassandra:active 2024-10-25 15:26:06,685 - INFO - config-zookeeper:active 2024-10-25 15:26:06,685 - INFO - config-rabbitmq:active 2024-10-25 15:26:06,685 - INFO - vrouter 2024-10-25 15:26:06,691 - INFO - vrouter-nodemgr:active 2024-10-25 15:26:06,697 - INFO - agent:active 2024-10-25 15:26:06,697 - INFO - control 2024-10-25 15:26:06,704 - INFO - control-nodemgr:active 2024-10-25 15:26:06,710 - INFO - control:active 2024-10-25 15:26:06,710 - INFO - named:active 2024-10-25 15:26:06,716 - INFO - dns:active 2024-10-25 15:26:06,716 - INFO - analytics 2024-10-25 15:26:06,723 - INFO - analytics-nodemgr:active 2024-10-25 15:26:06,728 - INFO - analytics-api:active 2024-10-25 15:26:06,735 - INFO - collector:active 2024-10-25 15:26:06,735 - INFO - analytics-database 2024-10-25 15:26:06,736 - INFO - analytics-cassandra:active 2024-10-25 15:26:06,742 - INFO - analyticsdb-nodemgr:active 2024-10-25 15:26:06,749 - INFO - query-engine:active 2024-10-25 15:26:06,749 - INFO - webui 2024-10-25 15:26:06,749 - INFO - webui:active 2024-10-25 15:26:06,749 - INFO - webui-middleware:active 2024-10-25 15:26:06,749 - INFO - redis:active 2024-10-25 15:26:06,749 - INFO - analytics_snmp 2024-10-25 15:26:06,755 - INFO - snmp-collector:active 2024-10-25 15:26:06,755 - INFO - snmp-topology:active 2024-10-25 15:26:06,755 - INFO - analytics_alarm 2024-10-25 15:26:06,755 - INFO - alarmgen:active 2024-10-25 15:26:06,756 - DEBUG - defaultdict(, {'10.0.0.31': {'svc-monitor': {'status': 'inactive', 'description': None}}}) 2024-10-25 15:26:06,756 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 0 2024-10-25 15:26:16,757 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-10-25 15:26:16,849 - DEBUG - Output : contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_provisioner_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:26:16,849 - INFO - 10.0.0.31 2024-10-25 15:26:16,849 - INFO - config 2024-10-25 15:26:16,856 - INFO - config-nodemgr:active 2024-10-25 15:26:16,862 - INFO - api-server:active 2024-10-25 15:26:16,868 - INFO - schema:active 2024-10-25 15:26:16,868 - INFO - svc-monitor:inactive 2024-10-25 15:26:16,873 - INFO - device-manager:active 2024-10-25 15:26:16,873 - INFO - config-database 2024-10-25 15:26:16,873 - INFO - config-cassandra:active 2024-10-25 15:26:16,873 - INFO - config-zookeeper:active 2024-10-25 15:26:16,873 - INFO - config-rabbitmq:active 2024-10-25 15:26:16,873 - INFO - vrouter 2024-10-25 15:26:16,879 - INFO - vrouter-nodemgr:active 2024-10-25 15:26:16,885 - INFO - agent:active 2024-10-25 15:26:16,885 - INFO - control 2024-10-25 15:26:16,891 - INFO - control-nodemgr:active 2024-10-25 15:26:16,897 - INFO - control:active 2024-10-25 15:26:16,897 - INFO - named:active 2024-10-25 15:26:16,904 - INFO - dns:active 2024-10-25 15:26:16,904 - INFO - analytics 2024-10-25 15:26:16,910 - INFO - analytics-nodemgr:active 2024-10-25 15:26:16,916 - INFO - analytics-api:active 2024-10-25 15:26:16,923 - INFO - collector:active 2024-10-25 15:26:16,923 - INFO - analytics-database 2024-10-25 15:26:16,923 - INFO - analytics-cassandra:active 2024-10-25 15:26:16,929 - INFO - analyticsdb-nodemgr:active 2024-10-25 15:26:16,935 - INFO - query-engine:active 2024-10-25 15:26:16,935 - INFO - webui 2024-10-25 15:26:16,936 - INFO - webui:active 2024-10-25 15:26:16,936 - INFO - webui-middleware:active 2024-10-25 15:26:16,936 - INFO - redis:active 2024-10-25 15:26:16,936 - INFO - analytics_snmp 2024-10-25 15:26:16,941 - INFO - snmp-collector:active 2024-10-25 15:26:16,941 - INFO - snmp-topology:active 2024-10-25 15:26:16,941 - INFO - analytics_alarm 2024-10-25 15:26:16,941 - INFO - alarmgen:active 2024-10-25 15:26:16,941 - DEBUG - defaultdict(, {'10.0.0.31': {'svc-monitor': {'status': 'inactive', 'description': None}}}) 2024-10-25 15:26:16,941 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 1 2024-10-25 15:26:26,943 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-10-25 15:26:27,036 - DEBUG - Output : contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_provisioner_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:26:27,036 - INFO - 10.0.0.31 2024-10-25 15:26:27,036 - INFO - config 2024-10-25 15:26:27,043 - INFO - config-nodemgr:active 2024-10-25 15:26:27,048 - INFO - api-server:active 2024-10-25 15:26:27,053 - INFO - schema:active 2024-10-25 15:26:27,053 - INFO - svc-monitor:inactive 2024-10-25 15:26:27,058 - INFO - device-manager:active 2024-10-25 15:26:27,058 - INFO - config-database 2024-10-25 15:26:27,058 - INFO - config-cassandra:active 2024-10-25 15:26:27,059 - INFO - config-zookeeper:active 2024-10-25 15:26:27,059 - INFO - config-rabbitmq:active 2024-10-25 15:26:27,059 - INFO - vrouter 2024-10-25 15:26:27,065 - INFO - vrouter-nodemgr:active 2024-10-25 15:26:27,071 - INFO - agent:active 2024-10-25 15:26:27,071 - INFO - control 2024-10-25 15:26:27,077 - INFO - control-nodemgr:active 2024-10-25 15:26:27,083 - INFO - control:active 2024-10-25 15:26:27,083 - INFO - named:active 2024-10-25 15:26:27,090 - INFO - dns:active 2024-10-25 15:26:27,090 - INFO - analytics 2024-10-25 15:26:27,097 - INFO - analytics-nodemgr:active 2024-10-25 15:26:27,102 - INFO - analytics-api:active 2024-10-25 15:26:27,109 - INFO - collector:active 2024-10-25 15:26:27,109 - INFO - analytics-database 2024-10-25 15:26:27,109 - INFO - analytics-cassandra:active 2024-10-25 15:26:27,116 - INFO - analyticsdb-nodemgr:active 2024-10-25 15:26:27,123 - INFO - query-engine:active 2024-10-25 15:26:27,123 - INFO - webui 2024-10-25 15:26:27,123 - INFO - webui:active 2024-10-25 15:26:27,123 - INFO - webui-middleware:active 2024-10-25 15:26:27,123 - INFO - redis:active 2024-10-25 15:26:27,123 - INFO - analytics_snmp 2024-10-25 15:26:27,128 - INFO - snmp-collector:active 2024-10-25 15:26:27,129 - INFO - snmp-topology:active 2024-10-25 15:26:27,129 - INFO - analytics_alarm 2024-10-25 15:26:27,129 - INFO - alarmgen:active 2024-10-25 15:26:27,129 - DEBUG - defaultdict(, {'10.0.0.31': {'svc-monitor': {'status': 'inactive', 'description': None}}}) 2024-10-25 15:26:27,129 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 2 2024-10-25 15:26:37,130 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-10-25 15:26:37,227 - DEBUG - Output : contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_provisioner_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:26:37,227 - INFO - 10.0.0.31 2024-10-25 15:26:37,227 - INFO - config 2024-10-25 15:26:37,234 - INFO - config-nodemgr:active 2024-10-25 15:26:37,239 - INFO - api-server:active 2024-10-25 15:26:37,246 - INFO - schema:active 2024-10-25 15:26:37,246 - INFO - svc-monitor:inactive 2024-10-25 15:26:37,251 - INFO - device-manager:active 2024-10-25 15:26:37,251 - INFO - config-database 2024-10-25 15:26:37,251 - INFO - config-cassandra:active 2024-10-25 15:26:37,251 - INFO - config-zookeeper:active 2024-10-25 15:26:37,251 - INFO - config-rabbitmq:active 2024-10-25 15:26:37,251 - INFO - vrouter 2024-10-25 15:26:37,257 - INFO - vrouter-nodemgr:active 2024-10-25 15:26:37,262 - INFO - agent:active 2024-10-25 15:26:37,262 - INFO - control 2024-10-25 15:26:37,268 - INFO - control-nodemgr:active 2024-10-25 15:26:37,275 - INFO - control:active 2024-10-25 15:26:37,275 - INFO - named:active 2024-10-25 15:26:37,282 - INFO - dns:active 2024-10-25 15:26:37,282 - INFO - analytics 2024-10-25 15:26:37,289 - INFO - analytics-nodemgr:active 2024-10-25 15:26:37,295 - INFO - analytics-api:active 2024-10-25 15:26:37,301 - INFO - collector:active 2024-10-25 15:26:37,302 - INFO - analytics-database 2024-10-25 15:26:37,302 - INFO - analytics-cassandra:active 2024-10-25 15:26:37,308 - INFO - analyticsdb-nodemgr:active 2024-10-25 15:26:37,315 - INFO - query-engine:active 2024-10-25 15:26:37,315 - INFO - webui 2024-10-25 15:26:37,315 - INFO - webui:active 2024-10-25 15:26:37,315 - INFO - webui-middleware:active 2024-10-25 15:26:37,315 - INFO - redis:active 2024-10-25 15:26:37,315 - INFO - analytics_snmp 2024-10-25 15:26:37,321 - INFO - snmp-collector:active 2024-10-25 15:26:37,321 - INFO - snmp-topology:active 2024-10-25 15:26:37,321 - INFO - analytics_alarm 2024-10-25 15:26:37,321 - INFO - alarmgen:active 2024-10-25 15:26:37,321 - DEBUG - defaultdict(, {'10.0.0.31': {'svc-monitor': {'status': 'inactive', 'description': None}}}) 2024-10-25 15:26:37,321 - DEBUG - Not all services up. Sleeping for 10 seconds. iteration: 3 2024-10-25 15:26:47,322 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-10-25 15:26:47,408 - DEBUG - Output : contrail_test_G48HBVwaI vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_snmp_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_api_1 analytics_collector_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_nodemgr_1 analytics_database_cassandra_1 control_named_1 control_control_1 control_nodemgr_1 control_provisioner_1 control_dns_1 webui_web_1 webui_job_1 config_devicemgr_1 config_provisioner_1 config_schema_1 config_dnsmasq_1 config_nodemgr_1 config_svcmonitor_1 config_api_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_provisioner_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-10-25 15:26:47,408 - INFO - 10.0.0.31 2024-10-25 15:26:47,408 - INFO - config 2024-10-25 15:26:47,415 - INFO - config-nodemgr:active 2024-10-25 15:26:47,420 - INFO - api-server:active 2024-10-25 15:26:47,425 - INFO - schema:active 2024-10-25 15:26:47,430 - INFO - svc-monitor:backup 2024-10-25 15:26:47,434 - INFO - device-manager:active 2024-10-25 15:26:47,435 - INFO - config-database 2024-10-25 15:26:47,435 - INFO - config-cassandra:active 2024-10-25 15:26:47,435 - INFO - config-zookeeper:active 2024-10-25 15:26:47,435 - INFO - config-rabbitmq:active 2024-10-25 15:26:47,435 - INFO - vrouter 2024-10-25 15:26:47,440 - INFO - vrouter-nodemgr:active 2024-10-25 15:26:47,446 - INFO - agent:active 2024-10-25 15:26:47,446 - INFO - control 2024-10-25 15:26:47,452 - INFO - control-nodemgr:active 2024-10-25 15:26:47,459 - INFO - control:active 2024-10-25 15:26:47,459 - INFO - named:active 2024-10-25 15:26:47,465 - INFO - dns:active 2024-10-25 15:26:47,465 - INFO - analytics 2024-10-25 15:26:47,471 - INFO - analytics-nodemgr:active 2024-10-25 15:26:47,477 - INFO - analytics-api:active 2024-10-25 15:26:47,484 - INFO - collector:active 2024-10-25 15:26:47,485 - INFO - analytics-database 2024-10-25 15:26:47,485 - INFO - analytics-cassandra:active 2024-10-25 15:26:47,491 - INFO - analyticsdb-nodemgr:active 2024-10-25 15:26:47,498 - INFO - query-engine:active 2024-10-25 15:26:47,498 - INFO - webui 2024-10-25 15:26:47,498 - INFO - webui:active 2024-10-25 15:26:47,498 - INFO - webui-middleware:active 2024-10-25 15:26:47,498 - INFO - redis:active 2024-10-25 15:26:47,498 - INFO - analytics_snmp 2024-10-25 15:26:47,504 - INFO - snmp-collector:active 2024-10-25 15:26:47,504 - INFO - snmp-topology:active 2024-10-25 15:26:47,504 - INFO - analytics_alarm 2024-10-25 15:26:47,504 - INFO - alarmgen:active 2024-10-25 15:26:47,504 - INFO - All the contrail services are up on all nodes 2024-10-25 15:26:47,504 - INFO - contrail-status passed 2024-10-25 15:26:47,629 - DEBUG - Skipping xmpp flap check
2024-10-25 15:26:47,630 - INFO - END TEST : test_contrail_status : PASSED[0:00:41]
2024-10-25 15:26:47,630 - INFO - --------------------------------------------------------------------------------