2025-01-30 Thu 00:51:17:341.622 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_INFO]: VersionInfoLog: {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-27 00:09:56.738111","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7562-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} src/contrail-common/base/misc_utils.cc 41 2025-01-30 Thu 00:51:17:341.803 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: ROLE : Generator 2025-01-30 Thu 00:51:17:341.815 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: MODULE : contrail-dns 2025-01-30 Thu 00:51:17:341.821 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-2668-2 2025-01-30 Thu 00:51:17:341.827 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: NODE TYPE : Control 2025-01-30 Thu 00:51:17:341.832 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: INSTANCE ID : 0 2025-01-30 Thu 00:51:17:341.839 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: HTTP SERVER PORT : 8092 2025-01-30 Thu 00:51:17:341.851 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-01-30 Thu 00:51:17:342.140 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: HTTP Introspect Init 2025-01-30 Thu 00:51:17:342.272 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8092 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-01-30 Thu 00:51:17:342.335 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: Sandesh Http Server Port: 8092 2025-01-30 Thu 00:51:17:342.391 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: NOT Writing http_port 8092TO : /tmp/contrail-dns.28029.http_port 2025-01-30 Thu 00:51:17:342.401 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: CONNECT TO COLLECTOR: 1 2025-01-30 Thu 00:51:17:342.501 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: Idle 2025-01-30 Thu 00:51:17:342.708 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: No Client: 1738198277342609 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:17:342.852 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: Logging: DISABLED -> ENABLED 2025-01-30 Thu 00:51:17:342.867 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-01-30 Thu 00:51:17:345.886 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: Processing scm::EvStart in state Idle 2025-01-30 Thu 00:51:17:345.936 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: Disconnect 2025-01-30 Thu 00:51:17:346.027 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: Processing scm::EvCollectorUpdate in state Disconnect 2025-01-30 Thu 00:51:17:346.286 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: Connect : Start Connect timer 10.0.0.36:8086 2025-01-30 Thu 00:51:17:346.360 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:346.457 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: SANDESH: Send FAILED: 1738198277346012 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:17:346.477 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:17:346.487 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:346.561 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: SANDESH: Send FAILED: 1738198277346116 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:17:346.571 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:17:346.584 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:346.670 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: SANDESH: Send FAILED: 1738198277346350 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:17:346.680 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:17:471.468 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.20.0.22:8093 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-01-30 Thu 00:51:17:471.579 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been started controller/src/dns/main.cc 380 2025-01-30 Thu 00:51:17:471.667 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 295 2025-01-30 Thu 00:51:17:471.768 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 159 2025-01-30 Thu 00:51:17:471.781 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 168 2025-01-30 Thu 00:51:17:471.923 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:471.960 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198277471744 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-01-30 Thu 00:51:17:472.239 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:17:633.440 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 152 2025-01-30 Thu 00:51:17:633.502 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 300 2025-01-30 Thu 00:51:17:633.565 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 578 2025-01-30 Thu 00:51:17:633.581 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 85 2025-01-30 Thu 00:51:17:635.524 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:635.600 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: SANDESH: Send FAILED: 1738198277633383 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-01-30 Thu 00:51:17:635.617 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:17:635.656 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:635.690 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: SANDESH: Send FAILED: 1738198277633554 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down ], ] ] ] 2025-01-30 Thu 00:51:17:635.702 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:17:661.201 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 93 2025-01-30 Thu 00:51:17:669.393 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 102 2025-01-30 Thu 00:51:17:669.462 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 108 2025-01-30 Thu 00:51:17:669.555 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:669.573 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 391 2025-01-30 Thu 00:51:17:669.577 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:669.909 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: SANDESH: Send FAILED: 1738198277669517 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:17:669.937 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:17:671.383 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:672.805 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:683.638 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:685.887 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:687.177 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:709.438 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:713.478 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:714.872 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:729.168 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:730.730 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:733.301 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:736.807 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:738.081 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:739.185 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:746.368 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:747.587 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:748.833 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:762.864 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:764.436 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:765.796 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:769.734 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:771.140 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:773.088 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:774.618 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:775.731 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:776.871 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:782.222 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:784.083 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:785.660 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:789.000 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:790.499 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:792.714 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:794.467 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:796.469 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:797.585 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:802.309 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:804.371 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:805.779 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:825.502 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:827.535 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:828.835 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:830.940 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:832.436 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:834.970 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:836.864 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:838.160 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:840.158 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:846.382 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:847.482 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:848.534 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:854.176 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:855.599 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:857.597 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:859.856 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:861.477 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:862.387 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:863.901 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:865.055 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:866.285 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:867.762 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:868.762 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:870.094 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:872.560 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:888.284 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:890.579 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:892.679 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:894.409 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:895.439 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:904.609 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:908.984 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:916.504 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:938.916 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:940.995 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:942.262 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:945.388 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:946.577 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:947.510 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:948.918 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:949.927 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:951.774 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:956.941 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:958.348 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:959.528 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:961.664 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:963.125 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:964.075 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:969.530 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:971.479 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:973.007 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:981.815 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:982.837 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:983.781 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:988.768 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:992.892 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:995.321 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:005.018 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:006.562 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:008.335 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:012.830 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:014.062 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:015.006 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:029.415 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:031.280 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:032.769 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:035.907 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:037.581 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:039.008 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:041.068 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:042.895 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:043.971 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:046.026 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:047.449 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:052.690 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:060.460 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:062.385 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:063.887 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:069.860 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:072.000 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:073.425 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:073.426 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:073.428 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:073.447 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:074.001 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:074.324 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:074.483 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:074.656 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 552 2025-01-30 Thu 00:51:18:074.689 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 191 2025-01-30 Thu 00:51:18:074.719 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 219 2025-01-30 Thu 00:51:18:075.776 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:18:075.855 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: SANDESH: Send FAILED: 1738198278074729 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:18:075.867 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:18:101.510 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:101.790 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:101.902 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:101.927 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:101.944 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:101.971 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:101.986 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.007 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.020 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.035 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5210-64c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.059 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx240h-poe controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.072 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.095 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.109 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.126 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.157 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.170 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.187 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5800 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.202 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.229 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.250 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-srx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.268 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-srx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.280 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.294 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.308 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-aa controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.336 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.364 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5400 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.401 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.422 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx1500 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.435 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.453 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.471 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.488 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4100 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.500 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.527 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vsrx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.539 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.554 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4200 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.568 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.583 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5600 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.594 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.614 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4600 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.654 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.674 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.692 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.707 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:image_upgrade_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.744 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.760 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.782 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.805 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-32c-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.819 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:check_multicast_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.846 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.862 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.883 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.899 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_mac_mob_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.926 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:102.942 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2010 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.956 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5120:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.971 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5120 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:102.983 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.002 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.028 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.043 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.061 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.078 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.100 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.115 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx204 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.133 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.149 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.164 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:infra-bms-access controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.176 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.192 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:telemetry controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.204 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.219 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.232 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:overlay-bgp controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.243 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.262 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.274 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.290 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.303 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-overlay-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.324 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:103.338 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.350 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:103.367 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:107.676 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:107.932 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-mx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:107.985 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-mx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.008 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.027 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating snmp-profile:default-domain:default-project:snmp-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.054 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.073 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.101 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.127 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:_internal_vn_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.164 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.183 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:_internal_ipam_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.198 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:default-project:_internal_ipam_ipv6_link_local,default-domain:default-project:_internal_vn_ipv6_link_local) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.212 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.234 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.255 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.277 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.299 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:pnf-service-chaining controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.312 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.329 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:pnf-servicechain controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.341 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.362 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.374 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.390 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.408 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.458 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.474 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.495 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.514 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-all-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.527 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.541 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.568 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.591 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.611 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-ebgp-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.634 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.669 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating grpc-profile:default-domain:default-project:grpc-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.696 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.723 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.744 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-access controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.765 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.780 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.806 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.823 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.842 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.862 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.884 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:port-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.896 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.912 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:firewall controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.924 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.942 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:108.966 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l2-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:108.985 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.005 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.020 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:underlay-ip-clos controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.035 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.052 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.070 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.090 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.114 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.131 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48t-6c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.146 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-48s-4c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.174 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.205 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.220 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.264 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.281 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dci-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.298 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.311 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.330 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.350 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.367 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.388 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.404 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vqfx-10000 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.426 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:vn-interconnect controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.443 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.459 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.477 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.496 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.515 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.535 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.552 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.568 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.585 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.597 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.613 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.629 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.658 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.681 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.696 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.720 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.737 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.753 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.765 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.779 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.811 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.831 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-32c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.843 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.858 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48y-8c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.871 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.890 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.907 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.921 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.943 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.958 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L2-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:109.981 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:109.999 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:110.014 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.028 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:110.046 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.069 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:110.083 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:110.101 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.121 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.143 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.161 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.178 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.197 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.218 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.236 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.251 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.268 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.293 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:110.309 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.326 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.339 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:110.358 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:110.370 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:110.383 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5220:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:110.397 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5220 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:110.408 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.090 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:118.362 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:118.441 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.479 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.498 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:118.533 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.555 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:route-reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:118.585 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.612 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:118.675 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.702 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:118.726 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:118.764 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.798 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-leaf:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:118.824 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:118.845 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.872 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:118.901 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.923 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:role_assignment_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:118.959 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.985 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:119.012 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.045 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.073 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.112 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.142 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.173 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.206 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.234 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.260 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.285 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.317 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.346 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.383 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.413 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:119.443 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.466 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:119.491 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_chassis_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:119.537 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.562 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:119.596 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.631 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.673 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.701 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.731 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.761 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.784 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.801 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.818 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.839 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-mcast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:119.852 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.870 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.888 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx960 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:119.906 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-3 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:119.928 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.946 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-access-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:119.959 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:119.983 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:119.997 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.009 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:erb-ucast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.031 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.047 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.089 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.110 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Lean-Spine-with-Route-Reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.147 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.173 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.192 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.227 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.251 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-peer-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.286 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.309 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.341 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.367 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.393 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.417 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.458 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.496 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.519 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_os_computes_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.565 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.588 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:container_cleanup_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.621 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.680 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.705 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-128c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.725 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:120.754 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.790 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.820 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.848 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.873 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.915 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.944 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:120.972 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:121.006 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:121.036 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:121.061 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:121.087 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:121.131 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:121.153 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:121.180 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:121.212 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:118.728 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:122.499 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:122.782 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:122.834 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:122.862 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:122.866 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 21a9b029-55ac-43e0-ab1b-8346e6af347f controller/src/ifmap/client/config_json_parser.cc 217 2025-01-30 Thu 00:51:18:122.913 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 21a9b029-55ac-43e0-ab1b-8346e6af347f controller/src/ifmap/client/config_json_parser.cc 217 2025-01-30 Thu 00:51:18:123.887 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 71aea6e1-4554-4442-8b0e-d06788cd7c08 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-30 Thu 00:51:18:125.349 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_ops_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:125.445 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.480 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.504 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.524 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.542 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.561 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-client controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:125.574 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.594 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.609 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-36q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:125.622 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:125.642 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.676 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.701 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.720 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.737 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.755 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.772 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.789 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.805 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.823 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.841 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.868 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.885 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:125.933 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.950 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:125.968 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:125.986 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.005 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.027 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.044 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.061 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.078 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.092 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:topology_discovery_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.116 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.130 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.145 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.162 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.180 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.197 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.215 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.232 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.247 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.261 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.287 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.300 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:server_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.328 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.355 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.383 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.406 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.422 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.447 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.472 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.490 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.506 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.528 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.550 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.577 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.600 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.640 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.679 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.708 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.740 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.776 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.807 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.829 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.847 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.863 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:search_ip_mac_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.887 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.904 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.916 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.948 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:126.962 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:126.975 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:node_profile_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.000 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.020 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.033 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.051 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.073 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:device-functional-group controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.094 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.108 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.127 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.157 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.178 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.202 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.221 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.236 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.248 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.267 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.280 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:rma_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.349 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.364 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.380 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.398 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.416 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.435 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.451 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.467 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.483 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.498 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.514 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.528 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.540 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.556 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.573 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Spine-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.592 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.616 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.636 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.673 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.695 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.709 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.729 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.747 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.763 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.778 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.794 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.809 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.824 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.839 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.856 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.885 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.898 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:erb-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:127.914 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.930 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.946 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.961 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.976 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:127.992 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.011 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.026 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.041 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.056 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.072 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.094 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.108 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.130 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.149 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.164 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.175 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.191 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.208 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.222 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-60c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.233 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.247 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-72q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.258 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.277 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.311 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.327 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx240 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.338 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.353 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx10003 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.363 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.377 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx480 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.388 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.404 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.420 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.435 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.450 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.464 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2020 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.475 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.491 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.505 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vmx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.516 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.533 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.544 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.561 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.579 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.596 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.619 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.658 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.712 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.738 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.762 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-48y controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.779 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.801 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.821 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.838 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.849 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.865 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.880 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.906 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.933 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.949 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.961 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:128.975 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:128.991 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.015 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.037 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:129.048 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.064 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:129.076 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.089 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:129.100 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.113 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:129.125 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.140 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.156 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.193 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:existing_fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:129.233 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.480 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:129.513 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.531 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-4 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:129.551 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.571 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.588 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:129.608 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.623 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:129.642 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.701 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.723 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:test_overlay_connectivity_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:129.961 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:129.985 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:130.029 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:130.048 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:130.086 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:130.101 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:130.408 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:130.442 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_interface_details_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:130.481 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:130.498 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hardware_inventory_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:130.538 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:130.552 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_device_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:130.788 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:277.234 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:279.102 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.165 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.188 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.245 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.275 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.294 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.314 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.330 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.348 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.370 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.390 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.410 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.437 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.450 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.466 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:vcenter_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.492 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.508 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.527 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.544 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.567 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.587 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hitless_upgrade_strategy_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.609 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.624 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.673 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.701 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.717 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.734 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.749 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.764 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.782 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.808 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.828 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.847 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.864 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.886 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.904 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.923 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-pnf-servicechain-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.945 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:279.962 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:279.983 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.007 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Gateway-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:280.035 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.063 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.085 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:280.102 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.127 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.158 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.176 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.193 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:280.212 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.241 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.267 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.298 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.323 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.341 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.358 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.375 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.391 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.411 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.428 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.445 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:280.465 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.481 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:280.500 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.514 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:280.538 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.565 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.598 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.614 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:280.635 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:280.664 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating netconf-profile:default-domain:default-project:netconf-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:280.683 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:282.030 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:283.142 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.185 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.206 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.226 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.243 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:ztp_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.270 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.308 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.326 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Storage-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.351 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.371 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.386 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.411 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.425 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:erb-leaf:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.447 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.476 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.493 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-32cd controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.507 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.523 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.542 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.557 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.575 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.593 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.617 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.641 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.671 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-fabric-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.693 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.712 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.728 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.751 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.769 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.786 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.803 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.823 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.839 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.864 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.881 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:283.897 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.914 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.930 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.950 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.967 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:283.984 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:284.002 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:299.721 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:299.942 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.000 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.026 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_role_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.076 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.103 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-spine:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.130 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.147 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-properties:default-global-system-config:config_property controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.172 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-properties controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.207 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.264 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_server_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.295 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.343 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_deactivate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.374 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.392 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:cli_sync_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.419 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.494 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-5 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.530 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.567 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.593 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.619 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.638 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-management-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.676 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.696 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Leaf-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.722 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.746 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.814 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.839 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.867 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:300.892 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:300.921 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.042 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:301.069 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.100 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.121 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.139 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.158 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.175 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.193 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.210 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.227 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.261 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.297 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.315 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.332 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:301.381 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.427 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:301.449 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.471 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.521 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-6 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:301.541 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.560 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:301.893 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: EndOfRib point was reached, IF-MAP objects have been created controller/src/dns/main.cc 86 2025-01-30 Thu 00:51:18:301.918 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS.0, counting 0 elements controller/src/dns/main.cc 98 2025-01-30 Thu 00:51:18:301.929 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS_record.0, counting 0 elements controller/src/dns/main.cc 98 2025-01-30 Thu 00:51:18:301.938 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.network_ipam.0, counting 3 elements controller/src/dns/main.cc 98 2025-01-30 Thu 00:51:18:301.948 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_network_network_ipam.0, counting 1 elements controller/src/dns/main.cc 98 2025-01-30 Thu 00:51:18:301.958 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.global_qos_config.0, counting 1 elements controller/src/dns/main.cc 98 2025-01-30 Thu 00:51:18:301.967 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: VnniConfig has been updated after the bulk sync, the number of elements: 1 controller/src/dns/main.cc 109 2025-01-30 Thu 00:51:18:301.975 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: IpamConfig has been updated after the bulk sync, the number of elements: 3 controller/src/dns/main.cc 120 2025-01-30 Thu 00:51:18:301.984 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 131 2025-01-30 Thu 00:51:18:301.992 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsRecordConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 142 2025-01-30 Thu 00:51:18:302.000 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: GlobalQosConfig has been updated after the bulk sync controller/src/dns/main.cc 152 2025-01-30 Thu 00:51:18:302.076 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 159 2025-01-30 Thu 00:51:18:302.087 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 168 2025-01-30 Thu 00:51:18:302.107 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:18:302.235 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: SANDESH: Send FAILED: 1738198278302041 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-01-30 Thu 00:51:18:302.246 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:18:435.807 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 152 2025-01-30 Thu 00:51:18:435.884 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666489403136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 219 2025-01-30 Thu 00:51:18:435.935 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:18:435.953 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:18:435.823 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:18:436.014 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: SANDESH: Send FAILED: 1738198278435742 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:18:436.026 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:18:436.038 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:18:436.046 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:18:436.102 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named up; DNS is operational controller/src/dns/mgr/dns_mgr.cc 737 2025-01-30 Thu 00:51:18:436.225 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:18:436.279 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Idle 2025-01-30 Thu 00:51:18:436.359 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:18:436.533 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: SANDESH: Send FAILED: 1738198278436173 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 870, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:18:436.554 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:18:436.566 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:18:436.608 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: SANDESH: Send FAILED: 1738198278436202 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:18:436.620 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:18:436.630 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:18:436.713 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:18:436.899 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: SANDESH: Send FAILED: 1738198278436346 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 871, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:18:436.923 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:19:324.381 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:423.462 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:436.365 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:51:19:436.607 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Connect : Start Connect timer 10.0.0.40:8086 2025-01-30 Thu 00:51:19:436.748 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:19:436.770 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:19:436.803 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:19:436.786 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: SANDESH: Send FAILED: 1738198279436439 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.40:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:19:436.837 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:19:436.850 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:19:437.041 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: SANDESH: Send FAILED: 1738198279436733 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 873, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 13, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:19:437.068 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:19:437.081 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:19:437.089 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:19:437.235 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:19:437.294 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Idle 2025-01-30 Thu 00:51:19:437.367 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:19:437.540 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: SANDESH: Send FAILED: 1738198279437169 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 873, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 15, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:19:437.561 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:19:437.573 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:19:437.597 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: SANDESH: Send FAILED: 1738198279437207 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:19:437.604 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:19:437.613 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:19:437.637 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:19:437.811 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: SANDESH: Send FAILED: 1738198279437356 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 154 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 874, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 15, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:19:437.829 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:19:475.442 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:540.078 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been done (the DB has been synced with named) controller/src/dns/mgr/dns_mgr.cc 455 2025-01-30 Thu 00:51:19:649.800 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:729.683 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666455815936, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:808.127 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:21:437.453 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:51:21:437.801 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Connect : Start Connect timer 10.0.0.43:8086 2025-01-30 Thu 00:51:21:437.830 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:21:437.867 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:21:437.991 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:21:438.028 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198281437569 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.43:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:21:438.038 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:21:438.049 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:21:438.058 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:21:438.166 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:21:438.206 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Idle 2025-01-30 Thu 00:51:21:438.279 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:21:438.461 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198281437966 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 879, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:21:438.489 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:21:438.502 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:21:438.672 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198281438119 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 879, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:21:438.689 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:21:438.700 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:21:438.723 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198281438142 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:21:438.731 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:21:438.742 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:21:438.762 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:21:438.922 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198281438265 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 880, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:21:439.003 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:25:438.378 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:51:25:438.860 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Connect : Start Connect timer 10.0.0.36:8086 2025-01-30 Thu 00:51:25:438.980 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:25:439.014 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: SANDESH: Send FAILED: 1738198285438463 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:25:439.030 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:25:439.040 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:25:439.211 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: SANDESH: Send FAILED: 1738198285438965 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 880, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 23, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:25:439.227 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:25:439.329 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:25:439.364 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:25:439.424 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:25:439.452 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:25:439.636 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:25:439.685 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Idle 2025-01-30 Thu 00:51:25:439.762 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:25:439.939 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: SANDESH: Send FAILED: 1738198285439577 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 880, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:25:439.961 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:25:439.972 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:25:439.996 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: SANDESH: Send FAILED: 1738198285439613 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:25:440.003 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:25:440.013 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:25:440.039 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:25:440.197 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: SANDESH: Send FAILED: 1738198285439747 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 881, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:25:440.213 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:33:439.860 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:51:33:440.172 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Connect : Start Connect timer 10.0.0.40:8086 2025-01-30 Thu 00:51:33:440.331 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:33:440.371 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: SANDESH: Send FAILED: 1738198293439972 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.40:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:33:440.381 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:33:440.391 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:33:440.496 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:33:440.532 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:33:440.657 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: SANDESH: Send FAILED: 1738198293440311 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 881, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:33:440.716 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:33:440.733 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:33:440.745 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:33:440.909 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:33:440.957 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Idle 2025-01-30 Thu 00:51:33:441.028 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:33:441.200 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: SANDESH: Send FAILED: 1738198293440841 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 881, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:33:441.221 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:33:441.232 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:33:441.298 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: SANDESH: Send FAILED: 1738198293440875 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:33:441.312 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:33:441.326 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:33:441.349 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:33:441.511 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: SANDESH: Send FAILED: 1738198293441016 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 882, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:33:441.531 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:47:343.077 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:47:343.179 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: SANDESH: Send FAILED: 1738198307342899 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 33 dequeues = 33 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 49 dequeues = 49 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198293440955 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198293441347 ] max_sm_queue_count = 5 ] 2025-01-30 Thu 00:51:47:343.218 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:47:343.228 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:47:343.403 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: SANDESH: Send FAILED: 1738198307343034 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 882, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:47:343.421 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:49:441.082 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:51:49:441.355 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Connect : Start Connect timer 10.0.0.43:8086 2025-01-30 Thu 00:51:49:441.468 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:49:441.501 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198309441167 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.43:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:49:441.511 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:49:441.520 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:49:441.549 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:49:441.588 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:49:441.766 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198309441452 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 882, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:49:441.804 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:49:441.816 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:49:441.824 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:49:441.934 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:49:441.971 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Idle 2025-01-30 Thu 00:51:49:442.053 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:49:442.218 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198309441885 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 882, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:49:442.238 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:49:442.249 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:49:442.273 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198309441909 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:49:442.280 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:49:442.290 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:49:442.309 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:49:442.468 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198309442043 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 883, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:49:442.484 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:17:343.350 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:17:343.481 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: SANDESH: Send FAILED: 1738198337343180 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 40 dequeues = 40 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 59 dequeues = 59 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198309441970 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198309442307 ] max_sm_queue_count = 5 ] 2025-01-30 Thu 00:52:17:343.514 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:17:343.527 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:17:343.698 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: SANDESH: Send FAILED: 1738198337343305 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 883, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:17:343.729 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:17:702.186 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666455815936, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:17:702.248 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666455815936, Pid 28071]: SANDESH: Send FAILED: 1738198337702076 [SYS_NOTICE]: UveDnsInfo: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 start_time = 1738198277471549 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-27 00:09:56.738111","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7562-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.36:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.22, ] ] ] 2025-01-30 Thu 00:52:17:702.274 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666455815936, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: UveDnsInfo 2025-01-30 Thu 00:52:19:442.141 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:52:19:442.443 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: Connect : Start Connect timer 10.0.0.36:8086 2025-01-30 Thu 00:52:19:442.604 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:52:19:442.648 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SANDESH: Send FAILED: 1738198339442266 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:52:19:442.660 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:52:19:442.669 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:52:19:442.875 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SANDESH: Send FAILED: 1738198339442581 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 883, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 43, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:19:442.900 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:19:443.090 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:52:19:443.127 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:52:19:443.212 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:52:19:443.255 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:52:19:443.555 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:52:19:443.611 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Idle 2025-01-30 Thu 00:52:19:443.739 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:19:444.068 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: SANDESH: Send FAILED: 1738198339443455 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 883, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:19:444.101 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:19:444.119 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:19:444.157 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: SANDESH: Send FAILED: 1738198339443517 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:52:19:444.172 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:52:19:444.187 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:52:19:444.218 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:19:444.467 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: SANDESH: Send FAILED: 1738198339443715 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 884, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:19:444.489 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:24:716.006 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:52:24:716.256 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:52:24:716.314 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:52:24:838.898 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:52:24:839.053 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:52:24:839.094 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:52:24:868.519 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:52:24:868.721 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:52:24:868.765 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:52:47:343.636 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:47:343.747 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: SANDESH: Send FAILED: 1738198367343448 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 48 dequeues = 48 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 70 dequeues = 70 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198339443609 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198339444215 ] max_sm_queue_count = 5 ] 2025-01-30 Thu 00:52:47:343.779 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:47:343.789 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:47:343.973 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: SANDESH: Send FAILED: 1738198367343593 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 893, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 48, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:47:343.990 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:49:443.764 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:52:49:444.068 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Connect : Start Connect timer 10.0.0.40:8086 2025-01-30 Thu 00:52:49:444.217 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:52:49:444.257 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: SANDESH: Send FAILED: 1738198369443869 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.40:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:52:49:444.267 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:52:49:444.277 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:52:49:444.318 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:52:49:444.365 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:52:49:444.468 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: SANDESH: Send FAILED: 1738198369444199 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 893, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 50, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:49:444.495 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:49:444.505 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:52:49:444.514 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:52:49:444.619 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:52:49:444.656 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Idle 2025-01-30 Thu 00:52:49:444.722 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:49:444.939 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: SANDESH: Send FAILED: 1738198369444572 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 893, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:49:444.963 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:49:444.974 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:49:444.999 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: SANDESH: Send FAILED: 1738198369444595 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:52:49:445.009 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:52:49:445.018 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:52:49:445.041 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:49:445.226 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: SANDESH: Send FAILED: 1738198369444709 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 894, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:49:445.275 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666460014336, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:17:344.065 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:17:344.184 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: SANDESH: Send FAILED: 1738198397343788 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 55 dequeues = 55 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 80 dequeues = 80 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198369444654 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198369445039 ] max_sm_queue_count = 5 ] 2025-01-30 Thu 00:53:17:344.202 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:17:344.213 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:17:344.396 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: SANDESH: Send FAILED: 1738198397344007 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 894, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 55, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:17:344.421 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:19:444.813 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:53:19:445.115 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Connect : Start Connect timer 10.0.0.43:8086 2025-01-30 Thu 00:53:19:445.139 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:53:19:445.173 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:53:19:445.280 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:53:19:445.326 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: SANDESH: Send FAILED: 1738198399444908 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.43:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:53:19:445.346 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:53:19:445.356 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:53:19:445.364 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:53:19:445.486 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:53:19:445.520 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Idle 2025-01-30 Thu 00:53:19:445.595 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:19:445.809 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: SANDESH: Send FAILED: 1738198399445232 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 894, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 57, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:19:445.831 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:19:445.842 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:19:446.018 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: SANDESH: Send FAILED: 1738198399445432 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 894, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 58, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:19:446.034 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:19:446.044 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:19:446.067 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: SANDESH: Send FAILED: 1738198399445462 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:53:19:446.075 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:53:19:446.084 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:53:19:446.105 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:19:446.278 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: SANDESH: Send FAILED: 1738198399445582 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 895, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 58, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:19:446.297 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666485204736, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:23:160.505 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:23:160.693 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:23:160.758 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:23:197.624 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:23:197.795 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:23:197.837 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:23:291.629 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:23:291.832 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:23:291.874 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:46:731.242 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:46:731.424 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:46:731.464 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666447419136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:46:865.025 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:46:865.179 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:46:865.220 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:46:997.462 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:46:997.730 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:46:997.804 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:47:344.333 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:47:344.440 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: SANDESH: Send FAILED: 1738198427344136 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 62 dequeues = 62 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 90 dequeues = 90 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198399445519 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198399446103 ] max_sm_queue_count = 5 ] 2025-01-30 Thu 00:53:47:344.473 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:47:344.486 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:47:344.755 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: SANDESH: Send FAILED: 1738198427344288 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 913, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 62, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:47:344.777 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:49:445.641 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:53:49:445.889 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: Connect : Start Connect timer 10.0.0.36:8086 2025-01-30 Thu 00:53:49:446.017 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:53:49:446.051 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: SANDESH: Send FAILED: 1738198429445724 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:53:49:446.062 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:53:49:446.071 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:53:49:446.254 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: SANDESH: Send FAILED: 1738198429445998 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 913, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 64, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:49:446.282 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:49:449.227 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.43:48090::10.0.0.36:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-30 Thu 00:53:49:449.280 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: 10.0.0.43:48090::10.0.0.36:8086(-1) OnSessionEvent TCP Connected 2025-01-30 Thu 00:53:49:449.289 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: 10.0.0.43:48090::10.0.0.36:8086(-1):EvTcpConnected 2025-01-30 Thu 00:53:49:449.349 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvTcpConnected in state Connect 2025-01-30 Thu 00:53:49:449.367 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-30 Thu 00:53:49:449.416 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ClientInit 2025-01-30 Thu 00:53:49:449.438 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2668-2:contrail-dns:0:Control count 1 2025-01-30 Thu 00:53:49:449.572 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state ClientInit 2025-01-30 Thu 00:53:49:449.585 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-30 Thu 00:53:49:449.615 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198429449407 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:53:49:449.623 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Received UVE message in wrong state : NodeStatusUVE 2025-01-30 Thu 00:53:49:449.633 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state ClientInit 2025-01-30 Thu 00:53:49:449.640 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-30 Thu 00:53:49:449.651 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Processing scm::EvSandeshSend in state ClientInit 2025-01-30 Thu 00:53:49:449.657 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-30 Thu 00:53:49:449.843 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: SANDESH: Send FAILED: 1738198429449559 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 914, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:49:449.861 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-30 Thu 00:53:49:457.907 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666443220736, Pid 28071]: OnMessage control in state: ClientInit 2025-01-30 Thu 00:53:49:458.012 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-01-30 Thu 00:53:49:458.055 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: ClientInit : EvSandeshMessageRecv 2025-01-30 Thu 00:53:49:458.102 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: Received Ctrl Message with size 0 2025-01-30 Thu 00:53:49:458.131 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2668-2 start_time = 1738198277471549 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-27 00:09:56.738111","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7562-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.36:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.22, ] ] proxy seq 1 2025-01-30 Thu 00:53:49:458.152 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-01-30 Thu 00:53:49:458.464 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2668-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 28071 http_port = 8092 start_time = 1738198277342514 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 62 dequeues = 62 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 90 dequeues = 90 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198399445519 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198399446103 ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 914, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 5 proxy seq 42 2025-01-30 Thu 00:53:49:458.516 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-01-30 Thu 00:53:49:458.555 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2668-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 26 2025-01-30 Thu 00:53:49:458.576 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-01-30 Thu 00:53:49:458.591 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-30 Thu 00:53:49:458.601 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-30 Thu 00:53:49:458.613 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-30 Thu 00:53:49:458.665 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: Established 2025-01-30 Thu 00:54:04:633.488 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:54:04:633.673 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:54:04:633.715 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:54:04:749.535 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666455815936, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:54:04:749.704 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666455815936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:54:04:749.746 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666455815936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:54:04:792.290 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:54:04:792.444 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:54:04:792.488 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:55:13:508.382 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:48602 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:55:13:659.313 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:53674 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:55:13:957.371 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:54572 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:55:14:368.369 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:54584 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:55:15:061.928 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:43220 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:55:15:443.147 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:53684 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:56:01:373.324 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2668-2:10.20.0.7 SEND Xmpp creating dynamic channel 10.20.0.22:8093::10.20.0.7:45927 controller/src/xmpp/xmpp_server.cc 586 2025-01-30 Thu 00:56:01:373.428 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2668-2:10.20.0.7 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2668-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-30 Thu 00:56:01:373.486 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8093::10.20.0.7:45927 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:56:01:373.783 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2668-2:10.20.0.7 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.7 ( ) controller/src/xmpp/xmpp_state_machine.cc 1326 2025-01-30 Thu 00:56:01:373.842 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-30 Thu 00:56:01:373.954 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 45927 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-30 Thu 00:56:01:396.882 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666468411136, Pid 28071]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2668-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-30 Thu 00:56:02:177.736 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:02:333.811 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:02:334.010 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2668-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:56:02:334.055 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:02:387.967 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2668-2:10.20.0.10 SEND Xmpp creating dynamic channel 10.20.0.22:8093::10.20.0.10:34781 controller/src/xmpp/xmpp_server.cc 586 2025-01-30 Thu 00:56:02:388.037 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2668-2:10.20.0.10 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2668-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-30 Thu 00:56:02:388.356 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8093::10.20.0.10:34781 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:56:02:388.428 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666451617536, Pid 28071]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2668-2:10.20.0.10 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.10 ( ) controller/src/xmpp/xmpp_state_machine.cc 1326 2025-01-30 Thu 00:56:02:388.437 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.10 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-30 Thu 00:56:02:388.642 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666464212736, Pid 28071]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.10 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 34781 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-30 Thu 00:56:02:413.683 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.10 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2668-2/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-30 Thu 00:56:02:745.484 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:02:745.684 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2668-2:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:56:02:745.761 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:02:745.807 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:02:781.201 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666493601536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:03:059.278 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:03:059.446 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2668-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:56:03:059.488 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:03:406.663 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666472609536, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:03:406.889 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2668-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:56:03:406.953 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:03:406.982 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666476807936, Pid 28071]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:03:479.992 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666481006336, Pid 28071]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 01:00:13:507.453 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:56808 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:00:13:659.348 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:42876 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:00:13:965.477 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:43884 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:00:14:371.410 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:43888 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:00:15:065.664 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:43466 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:00:15:449.467 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:42888 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:13:513.716 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:42860 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:13:665.218 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:42070 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:13:965.636 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:55114 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:14:372.285 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:55122 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:15:064.396 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:46840 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:15:445.747 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:42082 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:13:518.180 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:51710 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:13:669.066 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:47694 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:13:971.073 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:52568 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:14:376.940 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:52580 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:15:065.771 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:39790 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:15:450.295 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:47702 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:13:522.636 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:54318 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:13:674.822 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:50174 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:13:976.882 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:48820 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:14:381.265 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:48826 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:15:070.074 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:56894 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:15:453.390 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:50188 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:13:525.722 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:42350 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:13:676.970 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:48070 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:13:978.655 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:39640 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:14:382.659 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.5:39642 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:15:072.650 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.22:47404 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:15:453.070 UTC cn-jenkins-deploy-platform-ansible-os-2668-2 [Thread 140666649528448, Pid 28071]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.22:8092::10.20.0.18:48084 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254