2025-01-20 Mon 00:49:59:612.802 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_INFO]: VersionInfoLog: {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-16 00:14:43.877305","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7545-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} src/contrail-common/base/misc_utils.cc 41 2025-01-20 Mon 00:49:59:612.983 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: ROLE : Generator 2025-01-20 Mon 00:49:59:612.995 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: MODULE : contrail-dns 2025-01-20 Mon 00:49:59:613.000 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-2650-1 2025-01-20 Mon 00:49:59:613.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: NODE TYPE : Control 2025-01-20 Mon 00:49:59:613.010 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: INSTANCE ID : 0 2025-01-20 Mon 00:49:59:613.016 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: HTTP SERVER PORT : 8092 2025-01-20 Mon 00:49:59:613.027 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-01-20 Mon 00:49:59:613.255 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: HTTP Introspect Init 2025-01-20 Mon 00:49:59:613.424 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8092 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-01-20 Mon 00:49:59:613.484 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: Sandesh Http Server Port: 8092 2025-01-20 Mon 00:49:59:613.535 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: NOT Writing http_port 8092TO : /tmp/contrail-dns.82660.http_port 2025-01-20 Mon 00:49:59:613.577 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: CONNECT TO COLLECTOR: 1 2025-01-20 Mon 00:49:59:613.697 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: Idle 2025-01-20 Mon 00:49:59:613.874 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: No Client: 1737334199613795 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:49:59:614.411 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: Logging: DISABLED -> ENABLED 2025-01-20 Mon 00:49:59:614.457 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-01-20 Mon 00:49:59:618.734 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvStart in state Idle 2025-01-20 Mon 00:49:59:618.779 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Disconnect 2025-01-20 Mon 00:49:59:618.970 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvCollectorUpdate in state Disconnect 2025-01-20 Mon 00:49:59:619.268 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Connect : Start Connect timer 10.0.0.42:8086 2025-01-20 Mon 00:49:59:619.345 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:49:59:619.445 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: SANDESH: Send FAILED: 1737334199618955 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:49:59:619.462 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:49:59:619.472 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:49:59:619.560 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: SANDESH: Send FAILED: 1737334199619022 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:49:59:619.570 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:49:59:619.581 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:49:59:619.684 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: SANDESH: Send FAILED: 1737334199619334 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:49:59:619.699 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:49:59:965.017 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.20.0.7:8093 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-01-20 Mon 00:49:59:965.192 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been started controller/src/dns/main.cc 380 2025-01-20 Mon 00:49:59:965.262 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 295 2025-01-20 Mon 00:49:59:965.351 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 159 2025-01-20 Mon 00:49:59:965.366 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 168 2025-01-20 Mon 00:49:59:965.603 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:49:59:965.645 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SANDESH: Send FAILED: 1737334199965328 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-01-20 Mon 00:49:59:965.655 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:00:069.596 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 152 2025-01-20 Mon 00:50:00:069.655 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:00:069.733 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: SANDESH: Send FAILED: 1737334200069534 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-01-20 Mon 00:50:00:069.749 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:00:069.661 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 300 2025-01-20 Mon 00:50:00:070.234 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 578 2025-01-20 Mon 00:50:00:070.247 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 85 2025-01-20 Mon 00:50:00:070.264 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:00:070.326 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334200070209 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down ], ] ] ] 2025-01-20 Mon 00:50:00:070.339 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:00:140.031 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 93 2025-01-20 Mon 00:50:00:141.303 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 102 2025-01-20 Mon 00:50:00:141.364 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 108 2025-01-20 Mon 00:50:00:141.463 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:141.474 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 391 2025-01-20 Mon 00:50:00:141.558 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:00:141.623 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: SANDESH: Send FAILED: 1737334200141432 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:00:141.651 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:00:151.956 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:155.880 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:170.185 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:179.392 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:183.888 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:284.144 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:289.600 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:300.013 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:335.838 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:339.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:353.497 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:389.628 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:392.603 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:395.995 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:429.449 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:431.480 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:433.503 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:474.362 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:479.379 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:484.547 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:498.380 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:499.973 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:504.782 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:515.389 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:518.824 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:520.391 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:551.486 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:553.288 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:554.939 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:566.521 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:570.688 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:575.038 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:578.314 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:583.198 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:586.202 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:588.795 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:603.691 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:610.970 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:623.926 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:634.203 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:636.017 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:653.829 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:655.293 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:658.177 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:660.000 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:664.150 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:666.079 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:705.300 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:708.211 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:712.671 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:720.972 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:727.757 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:730.627 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:744.519 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:746.605 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:748.063 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:762.781 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:764.955 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:766.623 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:771.780 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:773.385 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:774.992 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:790.396 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:793.514 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:795.920 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:809.139 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:812.157 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:813.379 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:821.660 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:831.491 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:859.588 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:864.501 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:868.614 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:878.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:889.253 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:895.754 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:898.193 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:916.407 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:919.947 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:927.671 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:937.490 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:939.133 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:940.563 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:959.850 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:976.004 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:00:982.119 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:002.353 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:003.947 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:008.609 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:042.467 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:044.748 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:047.307 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:064.794 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:066.586 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:082.773 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:094.181 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:099.437 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:102.527 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:138.881 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:140.526 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:152.024 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:188.187 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:196.086 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:199.948 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:210.085 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:214.763 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:218.067 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:244.046 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:248.812 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:255.031 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:260.073 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:263.270 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:269.217 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:277.450 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:278.953 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:282.956 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:287.519 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:294.756 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:314.906 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-20 Mon 00:50:01:316.797 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-20 Mon 00:50:01:318.586 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-20 Mon 00:50:01:318.827 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-20 Mon 00:50:01:318.983 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-20 Mon 00:50:01:319.133 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-20 Mon 00:50:01:319.260 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-20 Mon 00:50:01:319.401 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741431707392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 552 2025-01-20 Mon 00:50:01:319.443 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741431707392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 191 2025-01-20 Mon 00:50:01:319.632 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:01:319.665 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: SANDESH: Send FAILED: 1737334201319481 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:01:319.673 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:01:319.834 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 219 2025-01-20 Mon 00:50:01:336.885 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:337.111 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:338.126 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:338.258 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:344.399 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:infra-bms-access controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:344.854 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:345.167 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:346.122 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:346.145 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5220:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:346.176 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5220 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:346.188 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:346.201 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:346.225 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:346.241 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:346.252 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hitless_upgrade_strategy_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:346.271 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:346.289 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:346.312 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:347.040 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:347.183 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48y-8c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:347.211 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:347.587 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_chassis_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:351.795 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:351.843 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:351.873 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:351.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:351.917 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:351.931 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-48y controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:351.946 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:351.957 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:device-functional-group controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:351.979 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:351.995 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:352.013 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:352.026 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:352.043 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:352.056 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Gateway-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:352.079 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:352.090 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:352.109 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:352.120 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:352.615 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:353.875 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:353.911 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:353.934 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:353.953 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:route-reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:353.977 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:353.997 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.016 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.031 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.047 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.070 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.100 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.114 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:underlay-ip-clos controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.125 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.141 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:telemetry controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.152 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.175 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:overlay-bgp controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.185 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.201 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.216 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.227 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.238 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.250 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating netconf-profile:default-domain:default-project:netconf-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.270 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.283 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Spine-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.303 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.322 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.335 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vmx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.351 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.366 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:ztp_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.388 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.400 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l2-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.431 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.465 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.478 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.544 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.560 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-32c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.571 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.587 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.601 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:image_upgrade_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.621 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.633 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.649 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:354.660 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:354.672 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:355.889 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:355.926 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:pnf-service-chaining controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:364.775 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:364.828 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:pnf-servicechain controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:364.841 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:364.861 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:364.879 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-60c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:364.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:364.942 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:364.966 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:364.979 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:364.991 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_role_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:365.018 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:365.037 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:365.051 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:365.066 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:365.086 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:365.100 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:365.120 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:365.134 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:365.149 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-client controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:365.159 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:365.174 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:365.185 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-aa controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:365.199 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-overlay-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:363.489 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:363.915 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:367.295 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance e629c448-82cf-44a5-8d46-2670e37dbb61 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 00:50:01:364.348 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:369.061 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:369.661 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 9daf18a3-d98c-4998-a14b-66920f4ab2ad controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 00:50:01:364.739 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741431707392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:376.994 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741431707392, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 18968228-aaec-4c03-8443-b0ef809a5b19 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 00:50:01:378.949 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 4ffcf4e5-d53c-406d-827c-f4a48f0700ea controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 00:50:01:379.341 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 9d8ae6b3-04bf-4e2d-9f8d-82f7b68168b7 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 00:50:01:379.426 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance a22df29f-de9c-4ba5-8202-c5cff385575f controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 00:50:01:380.007 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.096 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.115 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.232 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.256 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.273 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.289 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.305 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.317 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.331 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.357 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:search_ip_mac_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.392 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.406 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.436 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.452 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.467 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.478 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.490 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.509 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.527 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-all-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.538 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.549 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.579 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.605 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.620 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.633 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.671 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.688 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dci-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.704 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.715 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-properties:default-global-system-config:config_property controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.734 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-properties controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.747 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hardware_inventory_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.768 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.785 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-72q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.796 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-leaf:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.811 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.827 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.842 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.853 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.868 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.880 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.902 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.915 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.928 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.942 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-36q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.954 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.969 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:380.982 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vqfx-10000 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:380.992 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.006 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.023 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.036 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.046 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.061 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.082 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.101 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.112 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.127 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.141 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.156 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx480 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.169 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.185 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.200 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.212 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:firewall controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.225 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.239 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:vn-interconnect controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.249 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.263 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.277 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.293 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.307 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.320 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.335 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-mcast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.345 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.372 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.397 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.423 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.443 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.455 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.473 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.488 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.500 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.511 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.528 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.542 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.555 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.568 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.584 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.598 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.613 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.629 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.651 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.663 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5120 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.683 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.699 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.711 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48t-6c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.722 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.735 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.754 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.767 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.846 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.867 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-32c-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.880 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.912 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.929 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.946 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:381.961 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2020 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.976 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:381.990 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.002 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.024 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.036 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-spine:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.051 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.062 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.077 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-4 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.091 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.105 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating grpc-profile:default-domain:default-project:grpc-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.115 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.129 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.145 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.157 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4200 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.169 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:erb-leaf:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.185 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:erb-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.195 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.213 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.231 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:topology_discovery_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.250 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.263 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx240 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.282 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.295 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.308 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.323 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.343 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.373 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:port-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.383 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.400 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.431 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.452 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.475 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-access controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.495 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.520 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.537 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx240h-poe controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.561 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.575 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.591 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.606 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.624 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.638 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.653 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.666 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.685 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.699 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.712 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.726 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.743 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.756 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.771 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.791 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.804 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5600 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.815 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-5 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.830 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.847 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating snmp-profile:default-domain:default-project:snmp-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.858 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.869 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-fabric-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.885 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.899 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.916 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:382.929 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx204 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.943 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx960 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.953 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.963 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:382.980 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:node_profile_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.003 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.017 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.032 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.051 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.063 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.078 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.093 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.109 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.122 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.136 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.154 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.169 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.184 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.197 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.215 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.234 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.247 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:container_cleanup_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.269 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.282 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.293 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.303 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.319 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.330 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.352 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.367 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.383 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_interface_details_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.404 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.429 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.450 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.468 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.481 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-management-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.500 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.516 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.531 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.544 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-32cd controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.566 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.581 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.595 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.606 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-6 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.624 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.640 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.653 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:383.670 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.686 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.700 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.715 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.729 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:383.754 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.287 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.320 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.339 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5800 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.353 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.374 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.394 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:test_overlay_connectivity_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.454 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.484 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.503 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:cli_sync_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.537 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.555 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx1500 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.569 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.593 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.620 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.638 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-128c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.653 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:server_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.691 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.706 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.726 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.747 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.760 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4600 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.772 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.791 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.814 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.829 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Storage-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.847 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.868 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.887 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.901 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.923 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.936 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:394.952 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.974 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:394.993 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.008 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.024 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.040 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.058 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.071 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:395.087 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.116 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.131 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-mx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:395.149 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.166 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.183 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.197 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:395.207 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.221 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.240 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.254 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.284 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.296 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2010 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:395.309 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.321 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:395.331 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.345 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx10003 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:395.370 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.384 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.396 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:395.405 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.434 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.446 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:395.463 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.489 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.509 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.525 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.538 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.555 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.569 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.582 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.598 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:395.609 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.622 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.636 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.649 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.665 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.678 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.692 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:395.704 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:392.689 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile d21e436e-e28f-4769-9584-9728f9b6c801 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 00:50:01:396.233 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile d21e436e-e28f-4769-9584-9728f9b6c801 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 00:50:01:400.816 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:400.867 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.026 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5210-64c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:401.044 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.068 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:401.080 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.100 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.129 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.155 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.168 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:401.274 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.297 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_os_computes_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:401.318 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.347 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.366 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:401.384 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.421 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:401.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.466 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.483 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.500 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.519 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.535 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.565 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.582 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.598 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.615 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.636 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.657 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:401.671 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.689 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.703 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.721 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.735 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.754 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.770 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.783 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:401.800 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.824 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.846 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.864 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.882 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.910 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.924 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.941 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.955 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.968 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:401.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.006 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:erb-ucast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:402.017 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.031 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.049 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:402.069 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.083 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_ops_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:402.106 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.126 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:402.142 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.155 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:rma_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:402.181 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.195 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-pnf-servicechain-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:402.214 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.228 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:402.248 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.261 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:402.284 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.856 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5400 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:402.876 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:402.895 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.918 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.936 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.952 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.970 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:402.986 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.017 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.032 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:403.074 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.089 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:403.103 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.118 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.210 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.234 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.250 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.269 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.288 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.310 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:403.327 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:403.999 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.037 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-peer-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:404.062 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.083 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:404.101 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.210 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:404.226 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.249 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.266 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.283 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.298 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.322 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.337 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.378 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.396 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.838 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.859 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.872 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:404.894 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.908 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:404.927 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.943 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:_internal_vn_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:404.969 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:404.986 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:_internal_ipam_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:default-project:_internal_ipam_ipv6_link_local,default-domain:default-project:_internal_vn_ipv6_link_local) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.017 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.032 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.054 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5120:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.074 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.089 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.132 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.153 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:role_assignment_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.176 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.196 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.210 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.225 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.237 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.255 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.268 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.284 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.300 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Lean-Spine-with-Route-Reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.319 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.351 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.364 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.381 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.394 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.410 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.437 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L2-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.459 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.476 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.498 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.512 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.526 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.547 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.573 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.588 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_mac_mob_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.616 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.629 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.651 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.665 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-srx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.680 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-srx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.691 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.708 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-mx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.725 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.745 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.758 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-ebgp-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.843 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.870 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.883 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.912 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.926 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vsrx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.937 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4100 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.948 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:405.962 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.979 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:405.998 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:406.013 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:406.028 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:406.042 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:406.057 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:406.070 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:406.085 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:406.099 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:406.114 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:406.131 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:406.145 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_device_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:411.865 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:411.942 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:411.970 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:411.989 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:412.007 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:413.773 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:413.819 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:413.837 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:413.854 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:413.871 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:413.888 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:413.909 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:413.927 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-3 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:413.953 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:413.972 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-access-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:413.985 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.020 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:existing_fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:414.049 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.079 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.097 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.112 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.128 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.149 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:414.166 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.189 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.208 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.226 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.243 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.259 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.276 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.292 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.308 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.326 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.343 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.357 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_server_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:414.379 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.392 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:check_multicast_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:414.426 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.443 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:414.468 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.482 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:414.497 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.514 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.529 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.544 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.558 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.571 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.585 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.600 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.615 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.629 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.643 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.657 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.670 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:414.691 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.707 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:414.722 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.737 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:414.752 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.434 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.454 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Leaf-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:415.474 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.506 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.533 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.564 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-48s-4c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:415.575 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.591 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.612 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:415.630 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.646 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:415.670 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.693 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.711 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:415.728 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:415.742 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:416.290 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.310 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.326 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.356 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:vcenter_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:416.378 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.395 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:416.407 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:416.433 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.457 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.477 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.491 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:416.520 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.537 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.550 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:416.572 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.591 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.604 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:416.620 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.636 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.651 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.666 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.680 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.695 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.709 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.724 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.740 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.756 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.773 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:416.795 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.808 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:416.824 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.840 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.855 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.873 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.887 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.901 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.916 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.930 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.944 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.959 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.976 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:416.990 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_deactivate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:50:01:417.010 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:50:01:420.870 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: EndOfRib point was reached, IF-MAP objects have been created controller/src/dns/main.cc 86 2025-01-20 Mon 00:50:01:420.914 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS.0, counting 0 elements controller/src/dns/main.cc 98 2025-01-20 Mon 00:50:01:420.924 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS_record.0, counting 0 elements controller/src/dns/main.cc 98 2025-01-20 Mon 00:50:01:420.932 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.network_ipam.0, counting 3 elements controller/src/dns/main.cc 98 2025-01-20 Mon 00:50:01:420.941 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_network_network_ipam.0, counting 1 elements controller/src/dns/main.cc 98 2025-01-20 Mon 00:50:01:420.951 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.global_qos_config.0, counting 1 elements controller/src/dns/main.cc 98 2025-01-20 Mon 00:50:01:420.962 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: VnniConfig has been updated after the bulk sync, the number of elements: 1 controller/src/dns/main.cc 109 2025-01-20 Mon 00:50:01:420.975 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: IpamConfig has been updated after the bulk sync, the number of elements: 3 controller/src/dns/main.cc 120 2025-01-20 Mon 00:50:01:420.986 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 131 2025-01-20 Mon 00:50:01:420.996 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsRecordConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 142 2025-01-20 Mon 00:50:01:421.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: GlobalQosConfig has been updated after the bulk sync controller/src/dns/main.cc 152 2025-01-20 Mon 00:50:01:421.057 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 159 2025-01-20 Mon 00:50:01:421.067 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 168 2025-01-20 Mon 00:50:01:421.217 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:01:421.333 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: SANDESH: Send FAILED: 1737334201421040 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-01-20 Mon 00:50:01:421.348 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:01:676.089 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 152 2025-01-20 Mon 00:50:01:676.186 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 00:50:01:676.196 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1):EvTcpConnectFail 2025-01-20 Mon 00:50:01:676.238 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741431707392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 219 2025-01-20 Mon 00:50:01:676.275 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:01:676.323 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: SANDESH: Send FAILED: 1737334201676045 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:01:676.332 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:01:676.341 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 00:50:01:676.348 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Connect : EvTcpConnectFail 2025-01-20 Mon 00:50:01:676.705 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named up; DNS is operational controller/src/dns/mgr/dns_mgr.cc 737 2025-01-20 Mon 00:50:01:677.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 00:50:01:677.588 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Idle 2025-01-20 Mon 00:50:01:677.674 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:01:677.836 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: SANDESH: Send FAILED: 1737334201676460 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 880, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:01:677.850 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:01:677.860 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:01:677.882 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: SANDESH: Send FAILED: 1737334201676485 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:01:677.888 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:01:677.897 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 00:50:01:677.948 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:01:678.085 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: SANDESH: Send FAILED: 1737334201677660 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 882, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:01:678.100 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:01:724.609 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:724.747 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:01:724.782 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:01:724.792 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:01:724.813 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Created UUID read retry timer 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 840 2025-01-20 Mon 00:50:01:724.831 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:01:824.996 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:01:830.060 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:830.174 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:01:830.189 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:01:830.198 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:01:830.220 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:01:879.370 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741431707392, Pid 82765]: ConfigClientManager [SYS_WARN]: ConfigClientFQNameCache: FQ Name Cache entry not found on UPDATE: for object type: bgp_router with FQ name: default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2650-2 and uuid: 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_amqp_client.cc 334 2025-01-20 Mon 00:50:01:894.625 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:894.706 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:01:894.727 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Created UUID read retry timer 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 840 2025-01-20 Mon 00:50:01:894.745 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:01:897.282 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:897.434 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 666b6320-af65-4250-85a3-ffae7490bd3e controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 00:50:01:971.136 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741431707392, Pid 82765]: ConfigClientManager [SYS_WARN]: ConfigClientFQNameCache: FQ Name Cache entry not found on UPDATE: for object type: bgp_router with FQ name: default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2650-3 and uuid: 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_amqp_client.cc 334 2025-01-20 Mon 00:50:01:978.774 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:978.839 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:01:978.862 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Created UUID read retry timer 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 840 2025-01-20 Mon 00:50:01:978.874 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:01:993.817 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:993.960 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 666b6320-af65-4250-85a3-ffae7490bd3e controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 00:50:01:995.864 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:01:998.362 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:01:998.445 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:01:998.476 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:02:030.299 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:02:041.248 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:02:041.320 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:02:041.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:02:065.819 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:02:065.881 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:02:065.923 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:02:065.994 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 83709758-e089-442e-8bc2-4932e76c585a controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 00:50:02:069.865 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:02:069.945 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:02:069.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:02:070.046 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 182eed38-a088-41ce-8310-1c4f852a655f controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 00:50:02:167.326 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:02:171.946 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:02:172.027 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:02:172.045 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:02:270.095 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:02:275.665 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:02:275.735 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:02:275.756 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:02:372.155 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:02:375.277 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:02:375.374 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:02:375.394 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:02:441.490 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:02:444.126 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:02:444.192 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:02:444.217 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:02:675.889 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:02:687.344 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 00:50:02:687.693 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Connect : Start Connect timer 10.0.0.49:8086 2025-01-20 Mon 00:50:02:687.852 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:02:687.909 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:02:687.931 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:02:687.966 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:02:688.003 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: SANDESH: Send FAILED: 1737334202687427 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.49:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:02:688.020 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:02:688.031 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:02:688.057 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 00:50:02:688.069 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1):EvTcpConnectFail 2025-01-20 Mon 00:50:02:688.335 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: SANDESH: Send FAILED: 1737334202687879 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 166 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 941, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 13, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:02:688.367 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:02:688.384 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 00:50:02:688.395 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Connect : EvTcpConnectFail 2025-01-20 Mon 00:50:02:688.549 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 00:50:02:688.587 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Idle 2025-01-20 Mon 00:50:02:688.675 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:02:688.912 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: SANDESH: Send FAILED: 1737334202688481 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 41 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 944, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 15, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:02:688.934 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:02:688.945 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:02:688.967 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: SANDESH: Send FAILED: 1737334202688516 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:02:688.977 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:02:688.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 00:50:02:689.018 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:02:689.228 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: SANDESH: Send FAILED: 1737334202688658 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 41 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 945, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 15, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:02:689.250 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:02:775.506 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:02:777.881 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:02:777.974 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:02:778.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:02:912.574 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been done (the DB has been synced with named) controller/src/dns/mgr/dns_mgr.cc 455 2025-01-20 Mon 00:50:03:244.407 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:03:247.455 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:03:247.522 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:03:247.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:03:488.041 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:03:491.935 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:03:492.010 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:03:492.043 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:03:578.121 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:03:580.437 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:03:580.506 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:03:580.525 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:04:688.733 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 00:50:04:689.502 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-20 Mon 00:50:04:689.678 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:04:689.712 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: SANDESH: Send FAILED: 1737334204688847 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:04:689.731 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:04:689.740 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:04:689.855 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 00:50:04:689.952 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1):EvTcpConnectFail 2025-01-20 Mon 00:50:04:690.106 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: SANDESH: Send FAILED: 1737334204689659 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 171 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 53 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 962, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:04:690.130 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:04:690.142 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 00:50:04:690.150 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Connect : EvTcpConnectFail 2025-01-20 Mon 00:50:04:690.272 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 00:50:04:690.306 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Idle 2025-01-20 Mon 00:50:04:690.364 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:04:690.553 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: SANDESH: Send FAILED: 1737334204690217 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 171 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 53 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 962, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:04:690.570 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:04:690.579 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:04:690.599 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: SANDESH: Send FAILED: 1737334204690239 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:04:690.605 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:04:690.613 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 00:50:04:690.630 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:04:690.798 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: SANDESH: Send FAILED: 1737334204690353 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 171 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 53 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 963, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:04:690.812 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:04:847.672 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:04:850.429 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:04:850.512 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:04:850.544 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:05:092.156 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:05:095.895 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:05:095.991 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:05:096.014 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:05:180.687 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:05:183.251 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:05:184.252 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:05:184.295 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:08:050.691 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:08:053.182 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:08:053.240 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:08:053.263 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:08:296.125 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:08:298.845 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:08:298.915 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:08:298.943 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:08:384.418 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:08:387.259 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:08:387.323 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:08:387.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:08:690.459 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 00:50:08:690.706 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Connect : Start Connect timer 10.0.0.42:8086 2025-01-20 Mon 00:50:08:690.743 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 00:50:08:690.779 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1):EvTcpConnectFail 2025-01-20 Mon 00:50:08:690.840 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:08:690.871 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334208690530 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:08:690.880 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:08:690.888 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 00:50:08:690.895 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Connect : EvTcpConnectFail 2025-01-20 Mon 00:50:08:690.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 00:50:08:691.019 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Idle 2025-01-20 Mon 00:50:08:691.110 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:08:691.351 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334208690824 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 177 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 71 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 987, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 23, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:08:691.376 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:08:691.391 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:08:691.576 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334208690948 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 177 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 71 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 987, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 24, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:08:691.594 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:08:691.603 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:08:691.627 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334208690970 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:08:691.634 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:08:691.642 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 00:50:08:691.664 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:08:691.869 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334208691096 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 177 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 71 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 988, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 24, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:08:691.889 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:14:453.440 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:14:456.353 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:14:456.450 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:14:456.474 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:14:699.156 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:14:701.797 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:14:701.859 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:14:701.899 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:14:787.494 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:14:790.243 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:14:790.312 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:14:790.331 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:16:691.189 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 00:50:16:691.497 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Connect : Start Connect timer 10.0.0.49:8086 2025-01-20 Mon 00:50:16:691.618 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:16:691.648 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: SANDESH: Send FAILED: 1737334216691280 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.49:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:16:691.657 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:16:691.665 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:16:691.927 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: SANDESH: Send FAILED: 1737334216691603 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 180 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 80 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1000, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:16:691.957 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:16:691.971 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 00:50:16:692.020 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1):EvTcpConnectFail 2025-01-20 Mon 00:50:16:692.049 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 00:50:16:692.081 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Connect : EvTcpConnectFail 2025-01-20 Mon 00:50:16:692.278 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 00:50:16:692.326 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Idle 2025-01-20 Mon 00:50:16:692.448 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:16:692.662 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: SANDESH: Send FAILED: 1737334216692202 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 180 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 80 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1000, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:16:692.685 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:16:692.696 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:16:692.720 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: SANDESH: Send FAILED: 1737334216692245 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:16:692.726 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:16:692.734 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 00:50:16:692.761 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:16:692.925 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: SANDESH: Send FAILED: 1737334216692392 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 180 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 80 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1001, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:16:692.939 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:27:256.652 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:27:259.145 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:27:259.227 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:27:259.251 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:27:502.024 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:27:504.655 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:27:504.716 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:27:504.738 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:27:590.454 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:27:593.057 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:27:593.120 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:27:593.140 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:29:614.250 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:29:614.386 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SANDESH: Send FAILED: 1737334229614039 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 33 dequeues = 33 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 49 dequeues = 49 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737334216692325 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737334216692760 ] max_sm_queue_count = 5 ] 2025-01-20 Mon 00:50:29:614.432 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:29:614.446 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:29:614.770 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SANDESH: Send FAILED: 1737334229614214 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 183 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 89 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1013, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:29:614.790 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:32:692.435 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 00:50:32:692.685 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-20 Mon 00:50:32:692.797 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:32:692.828 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: SANDESH: Send FAILED: 1737334232692514 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:32:692.838 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:32:692.846 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:50:32:693.030 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: SANDESH: Send FAILED: 1737334232692782 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 183 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 89 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1013, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:32:693.054 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:32:693.352 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 00:50:32:693.365 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1):EvTcpConnectFail 2025-01-20 Mon 00:50:32:693.405 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 00:50:32:693.419 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Connect : EvTcpConnectFail 2025-01-20 Mon 00:50:32:693.577 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 00:50:32:693.609 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Idle 2025-01-20 Mon 00:50:32:693.674 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:32:693.854 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: SANDESH: Send FAILED: 1737334232693529 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 183 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 89 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1013, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:32:694.015 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:32:694.026 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:32:694.048 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: SANDESH: Send FAILED: 1737334232693557 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:50:32:694.055 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:50:32:694.063 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 00:50:32:694.091 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:32:694.256 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: SANDESH: Send FAILED: 1737334232693663 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 183 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 89 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1014, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:32:694.270 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:52:859.868 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:52:862.338 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:52:862.413 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:52:862.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:53:104.845 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:53:107.720 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:53:107.819 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:53:107.845 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:53:193.263 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:50:53:195.780 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:50:53:195.837 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:50:53:195.856 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:50:59:614.509 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:59:614.619 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: SANDESH: Send FAILED: 1737334259614336 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 40 dequeues = 40 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 59 dequeues = 59 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737334232693608 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737334232694089 ] max_sm_queue_count = 5 ] 2025-01-20 Mon 00:50:59:614.644 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:50:59:614.656 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:50:59:614.841 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: SANDESH: Send FAILED: 1737334259614461 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 186 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 98 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1026, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:50:59:614.856 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:51:00:192.717 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:00:192.787 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: SANDESH: Send FAILED: 1737334260192457 [SYS_NOTICE]: UveDnsInfo: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 start_time = 1737334199965164 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-16 00:14:43.877305","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7545-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.42:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.7, ] ] ] 2025-01-20 Mon 00:51:00:192.805 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: UveDnsInfo 2025-01-20 Mon 00:51:02:695.195 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 00:51:02:695.523 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: Connect : Start Connect timer 10.0.0.42:8086 2025-01-20 Mon 00:51:02:695.725 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:51:02:695.777 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: SANDESH: Send FAILED: 1737334262695321 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:51:02:695.787 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:51:02:695.795 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:51:02:695.985 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: SANDESH: Send FAILED: 1737334262695699 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 186 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 98 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1026, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 43, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:51:02:696.008 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:51:02:696.041 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 00:51:02:696.051 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1):EvTcpConnectFail 2025-01-20 Mon 00:51:02:696.090 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 00:51:02:696.103 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Connect : EvTcpConnectFail 2025-01-20 Mon 00:51:02:696.345 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 00:51:02:696.398 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Idle 2025-01-20 Mon 00:51:02:696.466 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:02:696.654 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: SANDESH: Send FAILED: 1737334262696297 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 186 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 98 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1026, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:51:02:696.671 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:51:02:696.681 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:02:696.719 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: SANDESH: Send FAILED: 1737334262696326 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:51:02:696.728 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:51:02:696.736 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 00:51:02:696.759 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:02:696.972 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: SANDESH: Send FAILED: 1737334262696453 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 186 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 98 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1027, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:51:02:696.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:51:05:172.686 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:51:05:172.855 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:51:05:172.895 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:51:05:296.238 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:51:05:296.430 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:51:05:296.480 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:51:05:336.150 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:51:05:336.350 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:51:05:336.426 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:51:29:614.810 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:29:614.917 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: SANDESH: Send FAILED: 1737334289614577 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 48 dequeues = 48 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 70 dequeues = 70 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737334262696397 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737334262696758 ] max_sm_queue_count = 5 ] 2025-01-20 Mon 00:51:29:614.931 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:51:29:614.940 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:29:615.184 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: SANDESH: Send FAILED: 1737334289614769 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 189 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 98 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1036, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 48, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:51:29:615.209 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:51:32:698.440 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 00:51:32:698.806 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Connect : Start Connect timer 10.0.0.49:8086 2025-01-20 Mon 00:51:32:698.986 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:51:32:699.027 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: SANDESH: Send FAILED: 1737334292698570 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.49:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:51:32:699.053 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:51:32:699.066 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:51:32:699.430 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: SANDESH: Send FAILED: 1737334292698966 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 189 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 98 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1036, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 50, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:51:32:699.455 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:51:32:699.512 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 00:51:32:699.527 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1):EvTcpConnectFail 2025-01-20 Mon 00:51:32:699.564 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 00:51:32:699.576 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Connect : EvTcpConnectFail 2025-01-20 Mon 00:51:32:699.728 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 00:51:32:699.783 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Idle 2025-01-20 Mon 00:51:32:699.884 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:32:700.237 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334292699674 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 189 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 98 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1036, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:51:32:700.265 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:51:32:700.280 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:32:700.317 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334292699708 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:51:32:700.326 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:51:32:700.339 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 00:51:32:700.388 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:32:700.697 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334292699867 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 189 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 98 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1037, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:51:32:700.726 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:51:44:062.563 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:51:44:065.269 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:51:44:065.324 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:51:44:065.345 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:51:44:307.955 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:51:44:310.991 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:51:44:311.061 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:51:44:311.085 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:51:44:395.972 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:51:44:398.672 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:51:44:398.743 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:51:44:398.762 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:51:59:615.174 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:59:615.269 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: SANDESH: Send FAILED: 1737334319614934 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 55 dequeues = 55 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 80 dequeues = 80 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737334292699781 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737334292700386 ] max_sm_queue_count = 5 ] 2025-01-20 Mon 00:51:59:615.283 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:51:59:615.293 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 00:51:59:615.553 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: SANDESH: Send FAILED: 1737334319615115 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 192 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 107 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1049, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 55, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:51:59:615.584 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:52:02:699.879 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 00:52:02:700.105 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-20 Mon 00:52:02:700.210 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:52:02:700.240 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334322699960 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:52:02:700.249 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 00:52:02:700.257 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 00:52:02:700.468 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737334322700196 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 192 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 107 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1049, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 57, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:52:02:700.493 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 00:52:02:703.095 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.42:45378::10.0.0.22:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-20 Mon 00:52:02:703.126 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:45378::10.0.0.22:8086(-1) OnSessionEvent TCP Connected 2025-01-20 Mon 00:52:02:703.134 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:45378::10.0.0.22:8086(-1):EvTcpConnected 2025-01-20 Mon 00:52:02:703.170 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Processing scm::EvTcpConnected in state Connect 2025-01-20 Mon 00:52:02:703.180 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-20 Mon 00:52:02:703.216 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ClientInit 2025-01-20 Mon 00:52:02:703.235 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2650-1:contrail-dns:0:Control count 1 2025-01-20 Mon 00:52:02:703.329 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 00:52:02:703.337 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-20 Mon 00:52:02:703.372 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: SANDESH: Send FAILED: 1737334322703208 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 00:52:02:703.380 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Received UVE message in wrong state : NodeStatusUVE 2025-01-20 Mon 00:52:02:703.388 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 00:52:02:703.394 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-20 Mon 00:52:02:703.405 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 00:52:02:703.411 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-20 Mon 00:52:02:703.599 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: SANDESH: Send FAILED: 1737334322703315 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 192 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 107 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1050, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 00:52:02:703.620 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-20 Mon 00:52:02:981.780 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:52:02:981.993 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:52:02:982.052 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:52:03:024.703 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:52:03:024.920 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:52:03:026.716 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:52:03:125.873 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:52:03:126.061 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:52:03:139.115 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:52:15:829.903 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: OnMessage control in state: ClientInit 2025-01-20 Mon 00:52:15:830.007 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-01-20 Mon 00:52:15:830.023 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ClientInit : EvSandeshMessageRecv 2025-01-20 Mon 00:52:15:830.056 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: Received Ctrl Message with size 0 2025-01-20 Mon 00:52:15:830.087 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2650-1 start_time = 1737334199965164 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-16 00:14:43.877305","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7545-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.42:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.7, ] ] proxy seq 1 2025-01-20 Mon 00:52:15:830.101 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 00:52:15:831.181 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 55 dequeues = 55 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 80 dequeues = 80 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737334292699781 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737334292700386 ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 192 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 107 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 454 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 258 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1050, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 5 proxy seq 37 2025-01-20 Mon 00:52:15:831.243 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 00:52:15:831.276 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 24 2025-01-20 Mon 00:52:15:831.288 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 00:52:15:831.299 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 00:52:15:831.306 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 00:52:15:831.314 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 00:52:15:831.376 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: Established 2025-01-20 Mon 00:52:27:340.094 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:52:27:340.284 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:52:27:340.325 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:52:27:448.773 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:52:27:448.928 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:52:27:448.965 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:52:27:482.756 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:52:27:482.923 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:52:27:482.961 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:52:28:489.865 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: OnMessage control in state: Established 2025-01-20 Mon 00:52:28:489.932 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshMessageRecv in state Established 2025-01-20 Mon 00:52:28:489.941 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Established : EvSandeshMessageRecv 2025-01-20 Mon 00:52:28:489.987 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Received Ctrl Message with size 3 2025-01-20 Mon 00:52:28:490.004 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for DnsState:0 period 0 cycle 0 with seqno 1, total = 0 2025-01-20 Mon 00:52:28:490.015 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 38, total = 0 2025-01-20 Mon 00:52:28:490.025 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 26, total = 0 2025-01-20 Mon 00:52:28:490.032 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 00:52:28:490.038 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 00:52:28:490.045 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 00:52:45:683.136 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:52:45:683.403 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:52:45:683.452 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:52:46:642.911 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:52:46:643.094 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:52:46:643.132 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:52:46:744.288 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:52:46:744.453 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:52:46:744.507 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:53:26:465.491 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:53:26:467.682 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:53:26:467.745 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:53:26:467.785 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:53:26:711.192 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:53:26:713.620 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:53:26:713.677 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:53:26:713.704 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:53:26:798.857 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:53:26:801.185 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:53:26:801.239 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:53:26:801.259 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:53:57:377.910 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:58054 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:53:57:864.901 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:36752 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:53:58:102.986 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:55144 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:53:58:342.104 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:36756 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:53:58:704.496 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:57082 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:53:59:849.204 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:57090 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:54:49:459.701 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:54:49:459.833 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:54:49:459.879 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:54:49:622.681 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:54:49:622.905 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2650-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:54:49:622.957 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:54:49:675.104 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.13 SEND Xmpp creating dynamic channel 10.20.0.7:8093::10.20.0.13:40673 controller/src/xmpp/xmpp_server.cc 586 2025-01-20 Mon 00:54:49:675.181 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.13 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2650-1 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-20 Mon 00:54:49:675.229 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8093::10.20.0.13:40673 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:54:49:675.348 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.13 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.13 ( ) controller/src/xmpp/xmpp_state_machine.cc 1326 2025-01-20 Mon 00:54:49:675.431 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 00:54:49:675.532 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 40673 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 00:54:49:705.269 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2650-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 00:54:50:001.903 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:54:50:002.123 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2650-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:54:50:004.752 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:54:50:004.800 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:54:50:053.458 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:54:50:573.452 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:55:39:777.757 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.8 SEND Xmpp creating dynamic channel 10.20.0.7:8093::10.20.0.8:35697 controller/src/xmpp/xmpp_server.cc 586 2025-01-20 Mon 00:55:39:777.815 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.8 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2650-1 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-20 Mon 00:55:39:777.846 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8093::10.20.0.8:35697 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:55:39:779.531 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:55:39:779.688 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.8 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.8 ( ) controller/src/xmpp/xmpp_state_machine.cc 1326 2025-01-20 Mon 00:55:39:779.722 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 00:55:39:779.845 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2650-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:55:39:779.885 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:55:39:779.947 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 35697 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 00:55:39:790.443 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2650-2/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 00:55:40:132.649 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:55:40:132.830 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2650-2:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 00:55:40:132.871 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:55:40:132.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 00:55:40:184.498 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:56:51:513.824 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:56:51:516.282 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:56:51:516.887 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:56:51:516.919 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:56:51:601.765 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:56:51:604.216 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:56:51:604.314 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:56:51:604.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:58:14:260.008 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 00:58:14:262.674 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 00:58:14:262.737 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 00:58:14:262.759 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 00:58:57:380.674 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:34442 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:58:57:874.144 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:55104 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:58:58:108.190 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:53006 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:58:58:346.934 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:55108 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:58:58:711.229 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:56330 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 00:58:59:852.136 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:56340 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:03:41:117.053 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 01:03:41:121.471 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:03:41:121.542 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:03:41:121.566 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:03:41:204.504 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 01:03:41:206.819 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:03:41:206.875 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:03:41:206.894 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:03:57:384.057 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:46304 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:03:57:878.064 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:53436 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:03:58:109.858 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:58186 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:03:58:349.902 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:53450 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:03:58:709.460 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:58328 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:03:59:854.078 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:58338 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:05:03:862.884 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 01:05:03:865.654 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:05:03:865.743 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:05:03:865.769 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:08:57:387.460 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:55576 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:08:57:879.795 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:46968 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:08:58:112.434 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:35436 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:08:58:355.213 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:46980 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:08:58:714.066 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:57216 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:08:59:855.916 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:57220 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:13:57:407.113 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:41542 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:13:57:888.133 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:47034 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:13:58:122.210 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:47864 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:13:58:363.934 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:47046 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:13:58:722.047 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:43488 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:13:59:859.440 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:43502 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:17:20:321.681 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 01:17:20:324.047 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:17:20:324.107 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:17:20:324.129 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:17:20:407.047 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 01:17:20:409.936 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:17:20:410.004 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:17:20:410.028 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:18:43:065.902 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 01:18:43:068.421 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:18:43:068.488 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:18:43:068.509 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:18:57:400.037 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:51180 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:18:57:885.537 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:49970 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:18:58:121.651 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:44912 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:18:58:362.730 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:49976 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:18:58:721.440 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:57064 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:18:59:858.714 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:57072 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:23:57:401.641 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:42326 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:23:57:888.208 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:53750 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:23:58:123.873 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:60268 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:23:58:363.783 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:53764 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:23:58:726.410 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:35586 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:23:59:861.512 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:35596 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:28:57:407.715 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:39862 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:28:57:892.923 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:36728 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:28:58:127.221 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:41762 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:28:58:365.859 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:36732 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:28:58:731.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:37544 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:28:59:867.328 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:37554 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:33:57:410.010 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:48396 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:33:57:900.567 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:43968 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:33:58:129.346 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:34422 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:33:58:366.029 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:43982 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:33:58:734.076 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:41786 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:33:59:876.188 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:41788 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:38:57:411.824 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:41276 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:38:57:898.644 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:32924 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:38:58:131.897 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:47980 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:38:58:368.912 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:32938 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:38:58:738.934 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:37126 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:38:59:871.305 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:37130 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:43:57:414.286 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:35272 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:43:57:898.060 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:56440 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:43:58:134.552 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:45924 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:43:58:370.348 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:56450 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:43:58:737.394 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:42282 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:43:59:874.117 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:42288 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:44:38:724.306 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 01:44:38:726.454 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:44:38:726.509 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:44:38:726.531 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:44:38:810.144 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 01:44:38:812.567 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:44:38:812.625 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:44:38:812.644 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:46:01:468.605 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: timer expired 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 878 2025-01-20 Mon 01:46:01:470.766 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:46:01:470.843 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:46:01:470.874 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:47:03:714.200 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.8 RECV Mode Server: Event: Tcp Connection Closed peer ip: 10.20.0.8 ( an-jenkins-deploy-platform-ansible-os-2650-2/dns ) controller/src/xmpp/xmpp_state_machine.cc 1311 2025-01-20 Mon 01:47:03:714.550 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Established next_state = Idle event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:47:03:714.630 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:47:03:718.425 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.8 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2650-1 To : an-jenkins-deploy-platform-ansible-os-2650-2/dns controller/src/xmpp/xmpp_connection.cc 734 2025-01-20 Mon 01:47:03:724.552 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:45378::10.0.0.22:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-20 Mon 01:47:03:724.589 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:45378::10.0.0.22:8086(-1):EvTcpClose 2025-01-20 Mon 01:47:03:724.712 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvTcpClose in state Established 2025-01-20 Mon 01:47:03:724.726 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Established : EvTcpClose 2025-01-20 Mon 01:47:03:725.057 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Connect : Start Connect timer 10.0.0.42:8086 2025-01-20 Mon 01:47:03:728.481 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:47:03:730.743 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: SANDESH: Send FAILED: 1737337623724871 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Established successful_connections = 1 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = cn-jenkins-deploy-platform-ansible-os-2650-2. collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 2445 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4206667 calls = 231 average_bytes = 18210 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 224 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 222 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1233, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 61, _iter59->first = sent _iter59->second = 235, ] ] ] 2025-01-20 Mon 01:47:03:730.885 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:47:03:730.907 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:47:03:730.946 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: SANDESH: Send FAILED: 1737337623724920 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Established : EvTcpClose -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:47:03:730.953 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:47:03:730.963 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvTcpDeleteSession in state Connect 2025-01-20 Mon 01:47:03:730.993 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:47:03:731.240 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: SANDESH: Send FAILED: 1737337623728441 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 1 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 2445 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4206667 calls = 231 average_bytes = 18210 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 224 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 222 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 77 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1233, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 61, _iter59->first = sent _iter59->second = 235, ] ] ] 2025-01-20 Mon 01:47:03:731.259 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:47:03:732.893 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.42:59064::10.0.0.42:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-20 Mon 01:47:03:732.915 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:59064::10.0.0.42:8086(-1) OnSessionEvent TCP Connected 2025-01-20 Mon 01:47:03:732.928 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:59064::10.0.0.42:8086(-1):EvTcpConnected 2025-01-20 Mon 01:47:03:732.974 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvTcpConnected in state Connect 2025-01-20 Mon 01:47:03:732.984 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-20 Mon 01:47:03:742.070 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ClientInit 2025-01-20 Mon 01:47:03:742.111 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2650-1:contrail-dns:0:Control count 2 2025-01-20 Mon 01:47:03:744.529 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:47:03:744.555 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-20 Mon 01:47:03:744.595 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: SANDESH: Send FAILED: 1737337623742034 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:47:03:744.604 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Received UVE message in wrong state : NodeStatusUVE 2025-01-20 Mon 01:47:03:744.613 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:47:03:744.619 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-20 Mon 01:47:03:744.631 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:47:03:744.637 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-20 Mon 01:47:03:745.076 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: SANDESH: Send FAILED: 1737337623744495 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 2 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 2445 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4206667 calls = 231 average_bytes = 18210 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 224 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 222 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 78 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1234, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 64, _iter59->first = sent _iter59->second = 235, ] ] ] 2025-01-20 Mon 01:47:03:745.113 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-20 Mon 01:47:03:781.725 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.13 RECV Mode Server: Event: Tcp Connection Closed peer ip: 10.20.0.13 ( an-jenkins-deploy-platform-ansible-os-2650-1/dns ) controller/src/xmpp/xmpp_state_machine.cc 1311 2025-01-20 Mon 01:47:03:781.999 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.13 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2650-1 To : an-jenkins-deploy-platform-ansible-os-2650-1/dns controller/src/xmpp/xmpp_connection.cc 734 2025-01-20 Mon 01:47:03:782.034 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:47:03:782.043 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ClientInit : EvSandeshSend : XmppConnectionLog 2025-01-20 Mon 01:47:03:782.054 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:47:03:782.061 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ClientInit : EvSandeshSend : XmppConnectionLog 2025-01-20 Mon 01:47:03:782.075 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Established next_state = Idle event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:47:03:782.151 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:47:03:880.498 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: OnMessage control in state: ClientInit 2025-01-20 Mon 01:47:03:880.550 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-01-20 Mon 01:47:03:880.559 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ClientInit : EvSandeshMessageRecv 2025-01-20 Mon 01:47:03:880.583 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Received Ctrl Message with size 0 2025-01-20 Mon 01:47:03:880.600 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2650-1 start_time = 1737334199965164 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-16 00:14:43.877305","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7545-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.42:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.7, ] ] proxy seq 1 2025-01-20 Mon 01:47:03:880.613 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 01:47:03:883.081 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 2 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 2445 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4206667 calls = 231 average_bytes = 18210 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 292 dequeues = 292 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 321 dequeues = 321 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Established state_since = 1737334335831374 last_state = Established last_event = scm::EvSandeshSend last_event_at = 1737337589668283 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 231 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 2445 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 4166162 calls = 228 average_bytes = 18272 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 224 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 222 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 78 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1234, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 64, _iter59->first = sent _iter59->second = 235, ] ] max_sm_queue_count = 6 proxy seq 261 2025-01-20 Mon 01:47:03:883.268 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 01:47:03:883.302 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 28 2025-01-20 Mon 01:47:03:883.314 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 01:47:03:883.321 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:47:03:883.328 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:47:03:883.335 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:47:03:883.377 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Established 2025-01-20 Mon 01:47:18:093.656 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.13 SEND Xmpp creating dynamic channel 10.20.0.7:8093::10.20.0.13:36141 controller/src/xmpp/xmpp_server.cc 586 2025-01-20 Mon 01:47:18:093.728 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.13 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2650-1 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-20 Mon 01:47:18:093.782 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8093::10.20.0.13:36141 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:47:18:093.846 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.13 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.13 ( ) controller/src/xmpp/xmpp_state_machine.cc 1326 2025-01-20 Mon 01:47:18:093.905 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:47:18:093.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 36141 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:47:18:136.522 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2650-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:47:19:085.971 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.8 SEND Xmpp creating dynamic channel 10.20.0.7:8093::10.20.0.8:35905 controller/src/xmpp/xmpp_server.cc 586 2025-01-20 Mon 01:47:19:086.048 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.8 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2650-1 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-20 Mon 01:47:19:086.167 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-1:10.20.0.8 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.8 ( ) controller/src/xmpp/xmpp_state_machine.cc 1326 2025-01-20 Mon 01:47:19:086.178 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:47:19:086.305 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 35905 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:47:19:086.093 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8093::10.20.0.8:35905 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:47:19:124.857 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2650-2/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:47:25:128.373 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:51402 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:47:27:564.135 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.11:51416 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:47:27:873.000 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:59210 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:47:30:162.046 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.18:59220 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:47:56:218.440 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:47:56:765.000 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:47:56:827.919 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:47:58:332.682 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:47:58:379.862 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:47:58:584.714 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:47:58:637.825 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:01:501.374 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:01:501.456 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 182eed38-a088-41ce-8310-1c4f852a655f:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:48:01:501.715 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 182eed38-a088-41ce-8310-1c4f852a655f src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:48:02:105.948 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:02:839.925 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:03:124.678 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:03:152.470 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:03:159.803 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 83709758-e089-442e-8bc2-4932e76c585a:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:48:03:159.846 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 83709758-e089-442e-8bc2-4932e76c585a src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:48:06:954.948 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:07:137.569 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:07:236.624 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:07:324.352 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:07:454.251 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:07:646.938 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:07:701.496 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:07:839.945 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:07:890.309 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:07:972.178 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:08:099.539 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:08:192.083 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:08:239.090 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:08:363.405 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:08:458.302 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:08:526.266 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:08:689.268 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:08:800.501 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:08:852.602 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:08:953.064 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:09:066.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:09:122.020 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:09:217.703 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:09:324.042 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:09:366.443 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:09:482.331 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:09:573.599 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:09:825.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:09:908.126 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:10:041.142 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:10:245.172 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:10:294.675 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:10:563.861 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:10:626.768 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:10:824.292 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:10:824.376 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:48:10:824.406 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:48:10:916.901 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:10:993.950 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:061.498 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:157.452 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:220.110 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:289.533 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:336.266 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:391.416 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:455.348 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:513.569 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:568.341 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:607.842 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:646.598 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:753.904 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:807.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:902.679 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:11:967.303 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:034.553 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:106.598 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:207.277 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:264.571 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:334.647 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:383.076 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:439.794 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:534.478 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:654.404 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:743.198 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:826.920 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:12:887.932 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:009.410 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:124.934 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:262.020 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:357.851 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:464.122 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:514.313 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:580.948 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:680.744 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:724.246 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:838.239 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:956.496 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:966.535 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:13:980.048 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:037.927 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:139.284 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:208.726 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:225.808 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:263.404 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:334.619 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:357.418 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:525.546 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:551.599 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:590.513 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:626.363 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:713.254 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:806.292 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:809.480 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:842.294 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:14:936.806 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:028.946 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:051.633 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:090.092 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:093.075 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:174.015 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:231.450 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:275.528 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:317.568 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:354.031 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:367.514 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:450.658 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:520.568 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:661.712 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:675.714 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:728.356 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:765.684 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:809.197 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:899.953 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:947.014 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:15:993.272 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:013.175 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:094.673 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:152.819 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:230.711 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:286.562 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:293.201 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:336.887 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:408.087 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:688.288 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:694.903 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:741.977 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:759.978 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:812.496 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:873.808 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:915.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:963.120 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:16:963.930 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:037.064 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:111.554 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:149.714 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:172.850 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:243.714 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:246.336 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:307.572 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:370.856 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:397.244 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:416.822 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:480.217 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:492.690 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:543.205 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:625.873 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:665.813 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:727.398 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:738.108 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:795.978 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:858.019 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:17:916.576 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:005.993 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:057.048 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:112.016 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:170.172 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:219.586 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:275.601 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:336.170 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:385.872 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:435.453 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:540.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:552.520 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:593.500 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:663.328 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:711.506 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:811.981 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:829.327 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:837.445 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:18:974.593 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:054.351 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:093.220 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:142.676 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:209.897 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:258.886 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:356.476 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:372.975 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:420.711 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:467.987 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:506.595 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:570.428 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:592.085 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:674.662 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:692.045 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:761.149 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:812.153 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:829.032 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:907.954 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:924.047 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:19:986.224 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:041.231 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:139.570 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:168.100 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:218.012 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:441.010 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:445.451 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:471.137 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:509.959 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:608.723 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:770.053 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:772.011 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:20:798.421 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:21:339.580 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:21:389.037 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:21:485.642 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:21:591.104 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:21:688.762 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:21:795.365 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:060.725 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:128.693 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:163.102 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:225.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:285.204 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:419.892 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:522.931 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:604.671 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:698.296 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:794.606 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:886.973 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:22:975.746 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:23:075.187 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:23:177.567 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:23:281.627 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:23:374.752 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:23:519.335 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:23:619.858 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:23:746.195 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:23:878.935 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:23:991.413 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:24:089.795 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:24:187.888 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:24:271.591 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:24:368.613 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:24:479.268 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:24:577.048 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:24:668.339 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:24:757.663 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:24:859.513 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:24:952.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:25:061.358 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:25:129.943 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:25:200.078 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:25:232.730 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:25:279.214 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:25:406.885 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:25:613.156 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:25:688.334 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:25:838.364 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:25:959.214 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:26:011.873 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:26:135.172 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:26:270.276 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:26:359.687 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:26:457.780 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:26:567.893 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:26:663.354 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:26:776.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:26:881.151 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:26:986.890 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:27:090.665 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:27:190.388 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:27:294.510 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:27:406.107 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:27:573.868 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:27:591.733 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:27:591.819 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:48:27:591.858 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:48:27:656.000 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:27:656.072 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Out of order parent or ref 00a3b93e-391a-42e7-8450-01d877ad1cf1:ref:bgp_router:666b6320-af65-4250-85a3-ffae7490bd3e src/contrail-common/config-client-mgr/config_cassandra_client.cc 955 2025-01-20 Mon 01:48:27:656.113 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientReadRetry: Start/restart UUID Read Retry timer due to configuration 00a3b93e-391a-42e7-8450-01d877ad1cf1 src/contrail-common/config-client-mgr/config_cassandra_client.cc 851 2025-01-20 Mon 01:48:27:745.957 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:27:837.224 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:27:954.861 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:28:089.701 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:28:223.822 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:28:312.032 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:28:439.374 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:28:569.097 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:28:689.315 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:28:784.618 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:28:922.740 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:024.067 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:143.446 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:201.078 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:320.189 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:407.123 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:492.677 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:584.948 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:679.035 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:747.715 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:841.844 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:29:952.932 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:30:051.789 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:30:156.303 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:30:252.828 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:30:332.904 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:30:432.247 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:30:548.407 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:30:635.944 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:30:760.082 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:30:859.365 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:30:938.117 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:040.603 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:139.181 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:238.167 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:340.587 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:420.147 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:508.567 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:609.661 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:706.474 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:780.035 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:887.897 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:31:979.182 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:074.971 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:151.319 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:236.463 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:308.611 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:388.013 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:476.906 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:560.075 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:636.550 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:730.754 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:807.689 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:896.703 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:32:971.523 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:047.396 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:135.973 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:219.120 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:317.628 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:400.282 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:530.867 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:609.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:695.452 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:797.372 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:886.986 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:33:972.308 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:062.884 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:141.153 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:216.389 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:302.011 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:390.591 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:468.806 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:566.579 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:660.133 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:744.163 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:843.677 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:34:909.919 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:010.159 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:106.246 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:197.565 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:283.960 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:355.666 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:431.990 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:528.075 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:613.139 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:698.584 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:780.940 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:865.349 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:35:950.145 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:048.374 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:125.837 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:233.703 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:322.914 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:402.579 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:489.589 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:583.296 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:662.159 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:751.509 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:847.970 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:36:933.950 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:025.571 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:103.151 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:187.866 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:262.916 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:348.950 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:452.728 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:541.910 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:634.727 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:737.109 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:798.968 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:885.212 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:37:960.939 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:040.783 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:119.292 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:203.466 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:279.402 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:369.758 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:462.240 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:540.055 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:622.198 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:698.664 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:772.854 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:861.088 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:38:937.720 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:016.810 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:111.957 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:183.130 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:254.453 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:347.610 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:446.011 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:553.622 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:660.126 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:744.711 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:831.598 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:39:927.265 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:005.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:085.009 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:169.999 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:256.442 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:350.976 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:449.873 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:533.004 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:613.200 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:698.554 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:789.740 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:863.683 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:40:951.082 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:030.282 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:110.877 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:213.375 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:303.173 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:383.465 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:467.048 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:551.822 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:640.377 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:743.157 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:844.065 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:41:919.529 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:002.483 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:094.032 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:159.383 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:245.010 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:327.094 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:408.759 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:489.899 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:560.151 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:646.813 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:732.058 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:817.377 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:895.972 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:42:976.935 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:050.167 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:130.935 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:204.818 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:285.391 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:357.697 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:442.979 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:513.044 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:590.783 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:687.243 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:771.009 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:855.393 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:937.822 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:015.607 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:117.627 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:117.876 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile d21e436e-e28f-4769-9584-9728f9b6c801 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 01:48:44:176.235 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:185.408 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile d21e436e-e28f-4769-9584-9728f9b6c801 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 01:48:44:252.658 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:252.787 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 18968228-aaec-4c03-8443-b0ef809a5b19 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 01:48:44:336.763 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:421.638 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:504.552 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740787504896, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:581.854 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:669.902 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:754.982 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:840.488 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:924.169 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:010.281 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:113.033 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:215.931 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:301.979 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:382.284 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741427508992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:462.954 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:544.467 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:617.572 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:700.861 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:795.959 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741398120192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:863.597 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:942.922 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:019.872 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:095.218 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741414913792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:179.372 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:260.346 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:351.361 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741419112192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:464.485 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741435905792, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:522.881 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:58:744.376 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:43778 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:48:59:886.892 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.7:8092::10.20.0.7:43788 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:50:15:044.711 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:59064::10.0.0.42:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-20 Mon 01:50:15:044.759 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:59064::10.0.0.42:8086(-1):EvTcpClose 2025-01-20 Mon 01:50:15:044.831 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvTcpClose in state Established 2025-01-20 Mon 01:50:15:044.849 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Established : EvTcpClose 2025-01-20 Mon 01:50:15:045.188 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Connect : Start Connect timer 10.0.0.49:8086 2025-01-20 Mon 01:50:15:045.354 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:15:045.792 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737337815044984 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Established successful_connections = 2 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = cn-jenkins-deploy-platform-ansible-os-2650-1. collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 3462 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4538838 calls = 263 average_bytes = 17257 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 714 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 236 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 86 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1753, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 262, ] ] ] 2025-01-20 Mon 01:50:15:046.109 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:15:046.136 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:15:046.180 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737337815045035 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Established : EvTcpClose -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:15:046.195 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:15:046.208 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvTcpDeleteSession in state Connect 2025-01-20 Mon 01:50:15:046.247 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:15:046.663 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: SANDESH: Send FAILED: 1737337815045329 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 2 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 3462 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4538838 calls = 263 average_bytes = 17257 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 714 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 236 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 86 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1753, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 262, ] ] ] 2025-01-20 Mon 01:50:15:046.700 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741402318592, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:15:051.176 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.42:36252::10.0.0.49:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-20 Mon 01:50:15:051.209 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:36252::10.0.0.49:8086(-1) OnSessionEvent TCP Connected 2025-01-20 Mon 01:50:15:051.221 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:36252::10.0.0.49:8086(-1):EvTcpConnected 2025-01-20 Mon 01:50:15:051.266 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Processing scm::EvTcpConnected in state Connect 2025-01-20 Mon 01:50:15:051.281 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-20 Mon 01:50:15:051.330 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ClientInit 2025-01-20 Mon 01:50:15:051.350 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2650-1:contrail-dns:0:Control count 3 2025-01-20 Mon 01:50:15:051.490 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:15:051.505 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-20 Mon 01:50:15:051.559 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: SANDESH: Send FAILED: 1737337815051319 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.49:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:15:051.571 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Received UVE message in wrong state : NodeStatusUVE 2025-01-20 Mon 01:50:15:051.583 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:15:051.593 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-20 Mon 01:50:15:051.608 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:15:051.617 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-20 Mon 01:50:15:052.037 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: SANDESH: Send FAILED: 1737337815051471 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 3 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 3462 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4538838 calls = 263 average_bytes = 17257 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 714 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 236 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 41 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 87 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1754, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 69, _iter59->first = sent _iter59->second = 262, ] ] ] 2025-01-20 Mon 01:50:15:052.071 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741423310592, Pid 82765]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-20 Mon 01:50:15:150.247 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.42:36252::10.0.0.49:8086(-1) < Read failed due to error system 104 : Connection reset by peer src/contrail-common/io/tcp_session.cc 507 2025-01-20 Mon 01:50:15:150.302 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.42:36252::10.0.0.49:8086(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 01:50:15:150.332 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:36252::10.0.0.49:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-20 Mon 01:50:15:150.343 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: 10.0.0.42:36252::10.0.0.49:8086(-1):EvTcpClose 2025-01-20 Mon 01:50:15:150.897 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvTcpClose in state ClientInit 2025-01-20 Mon 01:50:15:150.924 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: ClientInit : EvTcpClose 2025-01-20 Mon 01:50:15:151.159 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Return to idle with 30000 2025-01-20 Mon 01:50:15:151.175 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Idle 2025-01-20 Mon 01:50:15:151.283 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:15:151.815 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: SANDESH: Send FAILED: 1737337815151069 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 3 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 3462 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4540448 calls = 264 average_bytes = 17198 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 714 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 236 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 89 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1756, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 71, _iter59->first = sent _iter59->second = 263, ] ] ] 2025-01-20 Mon 01:50:15:151.859 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:15:151.879 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:15:151.913 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: SANDESH: Send FAILED: 1737337815151116 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.49:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:15:151.923 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:15:151.935 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 01:50:15:151.981 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:15:152.396 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: SANDESH: Send FAILED: 1737337815151266 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 3 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 3462 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4540448 calls = 264 average_bytes = 17198 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 714 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 236 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 89 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1756, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 71, _iter59->first = sent _iter59->second = 263, ] ] ] 2025-01-20 Mon 01:50:15:152.434 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741440104192, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:29:673.978 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:29:674.118 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: SANDESH: Send FAILED: 1737337829673770 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 337 dequeues = 337 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 11 dequeues = 11 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 375 dequeues = 375 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737337815151173 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737337815151978 ] max_sm_queue_count = 6 ] 2025-01-20 Mon 01:50:29:674.137 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:29:674.149 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:29:674.424 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: SANDESH: Send FAILED: 1737337829673914 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 3 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 3462 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4540448 calls = 264 average_bytes = 17198 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 714 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 236 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 89 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1756, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 74, _iter59->first = sent _iter59->second = 263, ] ] ] 2025-01-20 Mon 01:50:29:674.449 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741410715392, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:45:151.293 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 01:50:45:151.573 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-20 Mon 01:50:45:151.975 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 01:50:45:152.016 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1):EvTcpConnectFail 2025-01-20 Mon 01:50:45:151.981 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:45:152.073 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: SANDESH: Send FAILED: 1737337845151371 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:45:152.082 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:45:152.092 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:45:152.371 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: SANDESH: Send FAILED: 1737337845151739 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 3 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 3462 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4540448 calls = 264 average_bytes = 17198 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 714 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 236 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 46 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 89 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1756, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 76, _iter59->first = sent _iter59->second = 263, ] ] ] 2025-01-20 Mon 01:50:45:152.395 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:45:152.407 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 01:50:45:152.414 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Connect : EvTcpConnectFail 2025-01-20 Mon 01:50:45:152.559 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 01:50:45:152.590 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Idle 2025-01-20 Mon 01:50:45:152.661 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:45:152.930 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: SANDESH: Send FAILED: 1737337845152489 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 3 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 3462 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4540448 calls = 264 average_bytes = 17198 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 714 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 236 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 47 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 89 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1756, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 78, _iter59->first = sent _iter59->second = 263, ] ] ] 2025-01-20 Mon 01:50:45:152.962 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:45:152.977 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:45:153.008 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: SANDESH: Send FAILED: 1737337845152534 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:45:153.017 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:45:153.026 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 01:50:45:153.049 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:45:153.316 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: SANDESH: Send FAILED: 1737337845152646 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 3 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 3462 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4540448 calls = 264 average_bytes = 17198 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 714 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 236 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 47 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 90 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1757, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 78, _iter59->first = sent _iter59->second = 263, ] ] ] 2025-01-20 Mon 01:50:45:153.337 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741406516992, Pid 82765]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:47:152.735 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 01:50:47:153.020 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Connect : Start Connect timer 10.0.0.42:8086 2025-01-20 Mon 01:50:47:153.178 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:47:153.209 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: SANDESH: Send FAILED: 1737337847152843 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:47:153.218 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:47:153.225 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 01:50:47:153.267 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139741596031104, Pid 82765]: -(-1):EvTcpConnectFail 2025-01-20 Mon 01:50:47:153.228 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:47:153.661 UTC cn-jenkins-deploy-platform-ansible-os-2650-1 [Thread 139740783306496, Pid 82765]: SANDESH: Send FAILED: 1737337847153153 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-1:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 3 pid = 82765 http_port = 8092 start_time = 1737334199613708 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 3462 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 4540448 calls = 264 average_bytes = 17198 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientFQNameCache [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 714 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientReadRetry [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 164 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 236 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 49 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 90 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionDelete [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 16 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1757, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 81, _iter59->first = sent _iter59->second = 263, ] ] ]