2025-12-08 Mon 02:24:29:988.470 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_INFO]: VersionInfoLog: {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-08 00:08:21.879013", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12945-1.novalocal", "build-id": "v0+nightly", "build-number": "202512080007"}]} src/contrail-common/base/misc_utils.cc 39 2025-12-08 Mon 02:24:29:988.553 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: ROLE : Generator 2025-12-08 Mon 02:24:29:988.562 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: MODULE : contrail-dns 2025-12-08 Mon 02:24:29:988.568 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-4852-1 2025-12-08 Mon 02:24:29:988.573 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: NODE TYPE : Control 2025-12-08 Mon 02:24:29:988.578 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: INSTANCE ID : 0 2025-12-08 Mon 02:24:29:988.583 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: HTTP SERVER PORT : 8092 2025-12-08 Mon 02:24:29:988.589 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-12-08 Mon 02:24:29:991.034 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: HTTP Introspect Init 2025-12-08 Mon 02:24:29:991.173 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8092 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-12-08 Mon 02:24:29:991.279 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: Sandesh Http Server Port: 8092 2025-12-08 Mon 02:24:29:991.404 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: NOT Writing http_port 8092TO : /tmp/contrail-dns.71733.http_port 2025-12-08 Mon 02:24:29:991.420 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: CONNECT TO COLLECTOR: 1 2025-12-08 Mon 02:24:29:991.984 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: Idle 2025-12-08 Mon 02:24:29:992.203 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: No Client: 1765160669992108 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:29:992.384 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: Logging: DISABLED -> ENABLED 2025-12-08 Mon 02:24:29:992.406 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-12-08 Mon 02:24:29:992.478 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: Processing scm::EvStart in state Idle 2025-12-08 Mon 02:24:29:992.720 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: Disconnect 2025-12-08 Mon 02:24:29:992.794 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: Processing scm::EvCollectorUpdate in state Disconnect 2025-12-08 Mon 02:24:29:995.774 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: Connect : Start Connect timer 10.0.0.19:8086 2025-12-08 Mon 02:24:29:995.866 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:29:995.957 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: SANDESH: Send FAILED: 1765160669992781 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:29:995.981 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:29:995.994 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:29:996.299 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: SANDESH: Send FAILED: 1765160669992829 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:29:996.325 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:29:996.372 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:29:996.461 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: SANDESH: Send FAILED: 1765160669995846 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:29:996.474 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:30:911.295 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.20.0.249:8093 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-12-08 Mon 02:24:30:911.407 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been started controller/src/dns/main.cc 401 2025-12-08 Mon 02:24:30:911.456 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 281 2025-12-08 Mon 02:24:30:911.583 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 157 2025-12-08 Mon 02:24:30:911.595 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-12-08 Mon 02:24:30:916.329 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049874818624, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:30:916.400 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049874818624, Pid 71798]: SANDESH: Send FAILED: 1765160670911557 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-12-08 Mon 02:24:30:916.441 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049874818624, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:30:924.924 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 150 2025-12-08 Mon 02:24:30:924.985 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 285 2025-12-08 Mon 02:24:30:925.020 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 579 2025-12-08 Mon 02:24:30:925.573 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-12-08 Mon 02:24:30:926.707 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:30:926.757 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: SANDESH: Send FAILED: 1765160670924630 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-12-08 Mon 02:24:30:926.766 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:30:926.776 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:30:926.801 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: SANDESH: Send FAILED: 1765160670925013 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down ], ] ] ] 2025-12-08 Mon 02:24:30:926.808 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:30:955.612 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 94 2025-12-08 Mon 02:24:30:956.179 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 103 2025-12-08 Mon 02:24:30:956.202 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 109 2025-12-08 Mon 02:24:30:956.258 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:956.267 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 392 2025-12-08 Mon 02:24:30:956.356 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:30:956.402 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: SANDESH: Send FAILED: 1765160670956234 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:30:956.412 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:30:957.546 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:958.368 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:959.748 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:965.476 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:966.213 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:967.271 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:968.199 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:969.017 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:969.965 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:971.344 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:973.233 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:974.008 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:974.894 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:975.949 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:977.380 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:979.380 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:980.121 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:981.165 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:981.910 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:982.556 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:983.467 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:984.223 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:986.317 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:988.383 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:990.523 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:991.869 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:992.301 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:992.905 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:30:993.571 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:001.752 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:003.245 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:004.073 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:004.665 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:006.206 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:007.111 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:009.915 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:011.661 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:012.193 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:012.883 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:013.351 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:013.889 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:014.294 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:014.913 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:016.103 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:017.052 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:018.251 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:018.614 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:019.060 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:022.220 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:022.716 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:023.105 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:023.718 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:024.245 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:024.748 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:025.157 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:025.753 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:026.264 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:026.804 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:027.347 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:027.956 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:028.465 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:029.025 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:029.771 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:030.966 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:031.564 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:032.129 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:034.367 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:034.797 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:035.319 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:036.137 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:036.564 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:037.038 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:037.477 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:037.912 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:038.425 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:039.671 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:040.255 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:040.758 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:041.204 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:041.802 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:044.153 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:044.537 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:045.168 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:045.710 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:046.091 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:046.626 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:047.150 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:047.887 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:050.813 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:056.397 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:058.134 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:063.410 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:067.794 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:068.742 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:071.020 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:071.922 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:072.577 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:073.203 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:073.932 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:076.706 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:077.495 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:088.541 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:089.018 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:089.387 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:089.856 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:090.370 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:090.907 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:091.812 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:095.079 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:095.721 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:096.406 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:096.998 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:097.460 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:098.013 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:098.739 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:101.037 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:101.585 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:101.997 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:102.037 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-08 Mon 02:24:31:102.066 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049832834624, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-08 Mon 02:24:31:102.162 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-08 Mon 02:24:31:102.177 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049870620224, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-08 Mon 02:24:31:102.240 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-08 Mon 02:24:31:102.300 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-08 Mon 02:24:31:102.352 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 557 2025-12-08 Mon 02:24:31:102.378 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049618298432, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 553 2025-12-08 Mon 02:24:31:102.427 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049618298432, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 187 2025-12-08 Mon 02:24:31:102.477 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:31:102.506 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: SANDESH: Send FAILED: 1765160671102453 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:31:102.520 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:31:102.535 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 216 2025-12-08 Mon 02:24:31:105.932 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049870620224, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:105.998 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:106.388 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.421 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.439 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.497 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.518 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.530 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.547 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.559 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.571 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.586 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.605 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.616 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.632 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.659 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.678 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.688 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.699 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.714 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.723 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.734 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.750 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.761 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.772 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.783 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.822 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.839 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.852 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.863 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.890 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.901 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.911 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.920 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.933 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:106.943 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:106.956 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:107.157 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049618298432, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:107.205 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049832834624, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:107.262 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.288 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.318 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:107.335 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.371 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:107.386 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.401 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.420 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:107.436 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.448 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.470 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:107.488 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:107.501 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.518 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:107.534 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.557 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.568 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:107.581 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.597 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:107.614 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049866421824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:107.622 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049618298432, Pid 71798]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance e2cc5d3a-cf37-487a-9aa4-5b0458f656e4 controller/src/ifmap/client/config_json_parser.cc 222 2025-12-08 Mon 02:24:31:107.343 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:107.734 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 1c522637-efa5-4600-aafa-9ba9ba91cfdc controller/src/ifmap/client/config_json_parser.cc 222 2025-12-08 Mon 02:24:31:108.066 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.092 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.126 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.152 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.179 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.190 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:108.618 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance ea8eb393-91a7-4e70-a040-537f7c1fba58 controller/src/ifmap/client/config_json_parser.cc 222 2025-12-08 Mon 02:24:31:108.196 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.703 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.720 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.743 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.768 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.780 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.790 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.802 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.813 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.834 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.852 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.867 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.882 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.898 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.910 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.925 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.936 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.947 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.957 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.971 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:108.985 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:108.999 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:109.009 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:109.019 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:109.043 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:109.054 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:109.066 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:109.078 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4852-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:109.094 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:109.439 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:109.496 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0267f4e4-7a3f-48ef-8da5-df409a124506 controller/src/ifmap/client/config_json_parser.cc 222 2025-12-08 Mon 02:24:31:109.794 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:109.817 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:109.831 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4852-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:109.845 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:109.883 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:109.896 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:109.907 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:109.924 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:109.940 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:109.951 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:109.963 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:109.973 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:109.987 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:110.448 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:31:110.730 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:110.751 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:110.765 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:110.780 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:110.792 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:110.811 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:110.828 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:110.840 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:110.853 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:110.868 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:110.879 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:24:31:110.891 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:24:31:111.947 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: EndOfRib point was reached, IF-MAP objects have been created controller/src/dns/main.cc 83 2025-12-08 Mon 02:24:31:111.975 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS.0, counting 0 elements controller/src/dns/main.cc 96 2025-12-08 Mon 02:24:31:111.990 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS_record.0, counting 0 elements controller/src/dns/main.cc 96 2025-12-08 Mon 02:24:31:112.001 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.network_ipam.0, counting 2 elements controller/src/dns/main.cc 96 2025-12-08 Mon 02:24:31:112.015 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_network_network_ipam.0, counting 0 elements controller/src/dns/main.cc 96 2025-12-08 Mon 02:24:31:112.027 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.global_qos_config.0, counting 1 elements controller/src/dns/main.cc 96 2025-12-08 Mon 02:24:31:112.038 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: VnniConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 106 2025-12-08 Mon 02:24:31:112.046 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: IpamConfig has been updated after the bulk sync, the number of elements: 2 controller/src/dns/main.cc 117 2025-12-08 Mon 02:24:31:112.053 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 128 2025-12-08 Mon 02:24:31:112.067 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsRecordConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 139 2025-12-08 Mon 02:24:31:112.075 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: GlobalQosConfig has been updated after the bulk sync controller/src/dns/main.cc 149 2025-12-08 Mon 02:24:31:112.131 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 157 2025-12-08 Mon 02:24:31:112.141 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-12-08 Mon 02:24:31:112.142 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:31:113.051 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: SANDESH: Send FAILED: 1765160671112101 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-12-08 Mon 02:24:31:113.063 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:31:126.352 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 150 2025-12-08 Mon 02:24:31:126.409 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049618298432, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 216 2025-12-08 Mon 02:24:31:126.434 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-08 Mon 02:24:31:126.444 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1):EvTcpConnectFail 2025-12-08 Mon 02:24:31:126.370 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:31:126.510 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: SANDESH: Send FAILED: 1765160671126313 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:31:126.533 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:31:126.544 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Processing scm::EvTcpConnectFail in state Connect 2025-12-08 Mon 02:24:31:126.552 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Connect : EvTcpConnectFail 2025-12-08 Mon 02:24:31:126.565 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049832834624, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named up; DNS is operational controller/src/dns/mgr/dns_mgr.cc 735 2025-12-08 Mon 02:24:31:126.599 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-08 Mon 02:24:31:126.632 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Idle 2025-12-08 Mon 02:24:31:126.750 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:31:126.771 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: SANDESH: Send FAILED: 1765160671126576 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:31:126.778 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:31:126.786 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-08 Mon 02:24:31:126.836 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:31:126.990 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: SANDESH: Send FAILED: 1765160671126731 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 286, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:31:127.015 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:31:957.342 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049832834624, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:32:126.744 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-08 Mon 02:24:32:127.009 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Connect : Start Connect timer 10.0.0.19:8086 2025-12-08 Mon 02:24:32:127.149 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:32:127.180 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: SANDESH: Send FAILED: 1765160672126816 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:32:127.189 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:32:127.203 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:32:127.190 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-08 Mon 02:24:32:127.244 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1):EvTcpConnectFail 2025-12-08 Mon 02:24:32:127.367 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: SANDESH: Send FAILED: 1765160672127132 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 153 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 287, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 12, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:32:127.392 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:32:127.403 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvTcpConnectFail in state Connect 2025-12-08 Mon 02:24:32:127.411 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Connect : EvTcpConnectFail 2025-12-08 Mon 02:24:32:127.451 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-08 Mon 02:24:32:127.482 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Idle 2025-12-08 Mon 02:24:32:127.543 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:32:127.562 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: SANDESH: Send FAILED: 1765160672127430 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:32:127.569 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:32:127.576 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-08 Mon 02:24:32:127.599 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:32:127.734 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: SANDESH: Send FAILED: 1765160672127532 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 153 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 288, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 14, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:32:127.753 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:32:201.600 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049874818624, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:24:32:285.511 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been done (the DB has been synced with named) controller/src/dns/mgr/dns_mgr.cc 452 2025-12-08 Mon 02:24:34:127.570 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-08 Mon 02:24:34:127.897 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Connect : Start Connect timer 10.0.0.19:8086 2025-12-08 Mon 02:24:34:127.914 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-08 Mon 02:24:34:127.951 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1):EvTcpConnectFail 2025-12-08 Mon 02:24:34:128.037 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:34:128.066 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: SANDESH: Send FAILED: 1765160674127658 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:34:128.075 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:34:128.084 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Processing scm::EvTcpConnectFail in state Connect 2025-12-08 Mon 02:24:34:128.093 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Connect : EvTcpConnectFail 2025-12-08 Mon 02:24:34:128.135 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-08 Mon 02:24:34:128.167 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Idle 2025-12-08 Mon 02:24:34:128.255 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:34:128.395 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: SANDESH: Send FAILED: 1765160674128015 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 290, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:34:128.416 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:34:128.426 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:34:128.443 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: SANDESH: Send FAILED: 1765160674128115 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:34:128.452 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:34:128.459 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-08 Mon 02:24:34:128.485 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:34:128.621 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: SANDESH: Send FAILED: 1765160674128232 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 291, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 17, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:34:128.652 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049622496832, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:38:128.296 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-08 Mon 02:24:38:128.638 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Connect : Start Connect timer 10.0.0.19:8086 2025-12-08 Mon 02:24:38:128.674 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-08 Mon 02:24:38:128.705 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1):EvTcpConnectFail 2025-12-08 Mon 02:24:38:128.796 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:38:128.828 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: SANDESH: Send FAILED: 1765160678128426 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:38:128.837 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:38:128.846 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvTcpConnectFail in state Connect 2025-12-08 Mon 02:24:38:128.853 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Connect : EvTcpConnectFail 2025-12-08 Mon 02:24:38:128.893 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-08 Mon 02:24:38:128.920 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Idle 2025-12-08 Mon 02:24:38:128.990 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:38:129.112 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: SANDESH: Send FAILED: 1765160678128777 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 291, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:38:129.137 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:38:129.146 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:38:129.162 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: SANDESH: Send FAILED: 1765160678128873 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:38:129.168 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:38:129.175 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-08 Mon 02:24:38:129.208 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:38:129.301 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: SANDESH: Send FAILED: 1765160678128976 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 292, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:38:129.317 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:46:129.043 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-08 Mon 02:24:46:129.308 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Connect : Start Connect timer 10.0.0.19:8086 2025-12-08 Mon 02:24:46:129.333 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-08 Mon 02:24:46:129.367 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1):EvTcpConnectFail 2025-12-08 Mon 02:24:46:129.410 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:24:46:129.437 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: SANDESH: Send FAILED: 1765160686129142 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:46:129.471 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:46:129.481 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvTcpConnectFail in state Connect 2025-12-08 Mon 02:24:46:129.490 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Connect : EvTcpConnectFail 2025-12-08 Mon 02:24:46:129.533 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-08 Mon 02:24:46:129.565 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Idle 2025-12-08 Mon 02:24:46:129.625 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:46:129.802 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: SANDESH: Send FAILED: 1765160686129393 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 292, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 24, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:46:129.822 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:46:129.833 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:46:129.850 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: SANDESH: Send FAILED: 1765160686129510 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:24:46:129.857 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:24:46:129.865 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-08 Mon 02:24:46:129.889 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:46:130.017 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: SANDESH: Send FAILED: 1765160686129613 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 293, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:46:130.032 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:59:992.512 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:59:992.606 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: SANDESH: Send FAILED: 1765160699992391 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 28 dequeues = 28 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 44 dequeues = 44 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1765160686129564 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1765160686129888 ] max_sm_queue_count = 4 ] 2025-12-08 Mon 02:24:59:992.623 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:24:59:992.636 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:24:59:992.838 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: SANDESH: Send FAILED: 1765160699992480 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 293, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:24:59:992.868 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:25:02:129.720 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-08 Mon 02:25:02:130.062 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Connect : Start Connect timer 10.0.0.19:8086 2025-12-08 Mon 02:25:02:130.084 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-08 Mon 02:25:02:130.116 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1):EvTcpConnectFail 2025-12-08 Mon 02:25:02:130.468 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:25:02:130.516 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: SANDESH: Send FAILED: 1765160702129812 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:25:02:130.528 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:25:02:130.540 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Processing scm::EvTcpConnectFail in state Connect 2025-12-08 Mon 02:25:02:130.550 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Connect : EvTcpConnectFail 2025-12-08 Mon 02:25:02:130.627 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-08 Mon 02:25:02:130.676 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Idle 2025-12-08 Mon 02:25:02:130.769 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:25:02:130.978 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: SANDESH: Send FAILED: 1765160702130440 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 293, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:25:02:131.008 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:25:02:131.022 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:25:02:131.046 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: SANDESH: Send FAILED: 1765160702130600 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:25:02:131.058 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:25:02:131.069 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-08 Mon 02:25:02:131.101 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:25:02:131.279 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: SANDESH: Send FAILED: 1765160702130744 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 52 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 62 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 294, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 31, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:25:02:131.447 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:25:02:222.529 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:25:02:222.723 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4852-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:25:02:222.783 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:25:29:992.770 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:25:29:992.875 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: SANDESH: Send FAILED: 1765160729992620 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 34 dequeues = 34 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 53 dequeues = 53 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1765160702130675 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1765160702131100 ] max_sm_queue_count = 4 ] 2025-12-08 Mon 02:25:29:992.895 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:25:29:992.910 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:25:29:993.041 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: SANDESH: Send FAILED: 1765160729992717 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 155 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 53 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 63 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 297, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 34, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:25:29:993.072 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:25:30:911.561 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:25:30:911.630 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: SANDESH: Send FAILED: 1765160730911526 [SYS_NOTICE]: UveDnsInfo: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 start_time = 1765160670911392 build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-08 00:08:21.879013", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12945-1.novalocal", "build-id": "v0+nightly", "build-number": "202512080007"}]} collector = 10.0.0.19:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.249, ] ] ] 2025-12-08 Mon 02:25:30:911.656 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: UveDnsInfo 2025-12-08 Mon 02:25:32:130.791 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-08 Mon 02:25:32:131.081 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Connect : Start Connect timer 10.0.0.19:8086 2025-12-08 Mon 02:25:32:131.196 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:25:32:131.224 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: SANDESH: Send FAILED: 1765160732130869 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:25:32:131.244 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:25:32:131.257 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:25:32:131.418 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1) OnSessionEvent TCP Connect Failed 2025-12-08 Mon 02:25:32:131.442 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: -(-1):EvTcpConnectFail 2025-12-08 Mon 02:25:32:131.504 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: SANDESH: Send FAILED: 1765160732131177 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 155 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 53 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 63 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 297, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:25:32:131.531 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:25:32:131.543 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvTcpConnectFail in state Connect 2025-12-08 Mon 02:25:32:131.550 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Connect : EvTcpConnectFail 2025-12-08 Mon 02:25:32:131.618 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2025-12-08 Mon 02:25:32:131.664 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Idle 2025-12-08 Mon 02:25:32:131.726 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:25:32:131.744 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: SANDESH: Send FAILED: 1765160732131597 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:25:32:131.751 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:25:32:131.759 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvTcpDeleteSession in state Idle 2025-12-08 Mon 02:25:32:131.783 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:25:32:132.002 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: SANDESH: Send FAILED: 1765160732131714 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 155 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 53 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 63 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 298, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 39, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:25:32:132.042 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049841231424, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:25:34:287.585 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:25:34:287.781 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4852-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:25:34:287.834 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:25:49:953.242 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:25:49:953.422 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4852-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:25:49:953.475 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:25:59:992.997 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:25:59:993.088 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: SANDESH: Send FAILED: 1765160759992854 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 41 dequeues = 41 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 63 dequeues = 63 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1765160732131662 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1765160732131782 ] max_sm_queue_count = 4 ] 2025-12-08 Mon 02:25:59:993.103 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:25:59:993.113 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: Processing scm::EvSandeshSend in state Idle 2025-12-08 Mon 02:25:59:993.295 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: SANDESH: Send FAILED: 1765160759992950 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 157 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 55 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 65 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 304, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 41, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:25:59:993.321 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049609901632, Pid 71798]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:26:02:131.749 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-12-08 Mon 02:26:02:132.030 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: Connect : Start Connect timer 10.0.0.19:8086 2025-12-08 Mon 02:26:02:132.142 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:26:02:132.177 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: SANDESH: Send FAILED: 1765160762131821 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:26:02:134.932 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-12-08 Mon 02:26:02:134.965 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: Processing scm::EvSandeshSend in state Connect 2025-12-08 Mon 02:26:02:135.122 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: SANDESH: Send FAILED: 1765160762132122 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 157 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 55 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 65 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 304, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 43, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:26:02:135.158 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-12-08 Mon 02:26:02:135.203 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.19:53722::10.0.0.19:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 281 2025-12-08 Mon 02:26:02:135.230 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: 10.0.0.19:53722::10.0.0.19:8086(-1) OnSessionEvent TCP Connected 2025-12-08 Mon 02:26:02:135.241 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: 10.0.0.19:53722::10.0.0.19:8086(-1):EvTcpConnected 2025-12-08 Mon 02:26:02:135.322 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Processing scm::EvTcpConnected in state Connect 2025-12-08 Mon 02:26:02:135.342 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Connect : EvTcpConnected : Cancelling Connect timer 2025-12-08 Mon 02:26:02:135.454 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: ClientInit 2025-12-08 Mon 02:26:02:135.476 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-4852-1:contrail-dns:0:Control count 1 2025-12-08 Mon 02:26:02:135.602 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Processing scm::EvSandeshSend in state ClientInit 2025-12-08 Mon 02:26:02:135.615 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-12-08 Mon 02:26:02:135.658 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SANDESH: Send FAILED: 1765160762135444 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-12-08 Mon 02:26:02:135.671 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Received UVE message in wrong state : NodeStatusUVE 2025-12-08 Mon 02:26:02:135.683 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Processing scm::EvSandeshSend in state ClientInit 2025-12-08 Mon 02:26:02:135.691 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-12-08 Mon 02:26:02:135.716 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Processing scm::EvSandeshSend in state ClientInit 2025-12-08 Mon 02:26:02:135.725 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-12-08 Mon 02:26:02:135.942 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SANDESH: Send FAILED: 1765160762135580 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 157 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 55 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 65 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 305, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-12-08 Mon 02:26:02:135.979 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-12-08 Mon 02:26:02:137.835 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: OnMessage control in state: ClientInit 2025-12-08 Mon 02:26:02:140.267 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-12-08 Mon 02:26:02:140.999 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: ClientInit : EvSandeshMessageRecv 2025-12-08 Mon 02:26:02:141.032 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Received Ctrl Message with size 0 2025-12-08 Mon 02:26:02:141.052 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-4852-1 start_time = 1765160670911392 build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2025-12-08 00:08:21.879013", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-12945-1.novalocal", "build-id": "v0+nightly", "build-number": "202512080007"}]} collector = 10.0.0.19:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.249, ] ] proxy seq 1 2025-12-08 Mon 02:26:02:141.065 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-12-08 Mon 02:26:02:141.299 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-4852-1:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 71798 http_port = 8092 start_time = 1765160669992007 collector_name = collector_ip = 10.0.0.19:8086 collector_list= [ [ (*_iter40) = 10.0.0.19:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 41 dequeues = 41 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 63 dequeues = 63 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1765160732131662 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1765160732131782 ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 157 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 55 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 65 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 305, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 4 proxy seq 25 2025-12-08 Mon 02:26:02:141.342 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-12-08 Mon 02:26:02:141.366 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-4852-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.19:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.19:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.19:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 22 2025-12-08 Mon 02:26:02:141.377 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-12-08 Mon 02:26:02:141.384 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-12-08 Mon 02:26:02:141.390 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-12-08 Mon 02:26:02:141.397 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-12-08 Mon 02:26:02:141.430 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049862223424, Pid 71798]: Established 2025-12-08 Mon 02:26:03:307.787 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:26:03:307.927 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4852-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:26:03:307.962 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:28:30:596.284 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-4852-1:10.20.0.249 SEND Xmpp creating dynamic channel 10.20.0.249:8093::10.20.0.249:38369 controller/src/xmpp/xmpp_server.cc 577 2025-12-08 Mon 02:28:30:596.346 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-4852-1:10.20.0.249 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-4852-1 To : controller/src/xmpp/xmpp_connection.cc 725 2025-12-08 Mon 02:28:30:596.400 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.249:8093::10.20.0.249:38369 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 255 2025-12-08 Mon 02:28:30:596.481 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049837033024, Pid 71798]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-4852-1:10.20.0.249 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.249 ( ) controller/src/xmpp/xmpp_state_machine.cc 1323 2025-12-08 Mon 02:28:30:596.500 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.249 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-12-08 Mon 02:28:30:596.766 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049853826624, Pid 71798]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.249 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 38369 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-12-08 Mon 02:28:30:600.511 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.249 state = Active next_state = Established event = EvXmppOpen identifier = cn-jenkins-deploy-platform-ansible-os-4852-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-12-08 Mon 02:28:34:231.098 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049870620224, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:28:34:334.865 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049832834624, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:28:34:335.036 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049832834624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4852-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:28:34:335.075 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049832834624, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:28:34:654.966 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:28:34:655.158 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4852-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:28:34:655.205 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:28:34:655.236 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:28:34:700.391 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:28:35:221.975 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049874818624, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:28:54:244.448 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.249:8092::10.20.0.249:33626 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 255 2025-12-08 Mon 02:28:54:716.976 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049887764608, Pid 71798]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.249:8092::10.20.0.249:33636 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 255 2025-12-08 Mon 02:30:01:034.114 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:01:034.317 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:admin controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:30:01:034.375 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:30:01:066.287 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:01:066.437 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:admin:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:30:01:066.469 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:30:01:103.016 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:01:103.159 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:30:01:247.473 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:01:247.687 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:admin:default controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:30:01:247.743 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:30:01:326.902 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049874818624, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:01:327.209 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:30:01:327.283 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:30:01:346.876 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049845429824, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:01:373.993 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049614100032, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:01:374.188 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:admin:tf-tempest-test controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:30:01:374.258 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:30:01:406.677 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:01:499.571 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:01:499.741 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip-pool:default-domain:admin:tf-tempest-test:floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:30:01:499.779 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049849628224, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:30:01:568.683 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:01:568.880 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:30:01:568.918 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049858025024, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:30:02:159.879 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:02:179.512 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:02:179.601 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 9d2a103b-1bcb-4f0c-b8b5-3a9126af7881 controller/src/ifmap/client/config_json_parser.cc 222 2025-12-08 Mon 02:30:03:541.217 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572 2025-12-08 Mon 02:30:03:541.395 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:admin:tf-tempest-test,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-12-08 Mon 02:30:03:541.417 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:30:03:541.433 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049879017024, Pid 71798]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-12-08 Mon 02:30:03:564.843 UTC cn-jenkins-deploy-platform-ansible-os-4852-1 [Thread 140049828501056, Pid 71798]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 572