2025-01-30 Thu 00:51:17:534.064 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_INFO]: VersionInfoLog: {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-27 00:09:56.738111","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7562-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} src/contrail-common/base/misc_utils.cc 41 2025-01-30 Thu 00:51:17:534.279 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: ROLE : Generator 2025-01-30 Thu 00:51:17:534.296 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: MODULE : contrail-dns 2025-01-30 Thu 00:51:17:534.305 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-2668-3 2025-01-30 Thu 00:51:17:534.314 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: NODE TYPE : Control 2025-01-30 Thu 00:51:17:534.323 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: INSTANCE ID : 0 2025-01-30 Thu 00:51:17:534.333 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: HTTP SERVER PORT : 8092 2025-01-30 Thu 00:51:17:534.350 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-01-30 Thu 00:51:17:534.796 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: HTTP Introspect Init 2025-01-30 Thu 00:51:17:535.009 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8092 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-01-30 Thu 00:51:17:535.101 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: Sandesh Http Server Port: 8092 2025-01-30 Thu 00:51:17:535.178 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: NOT Writing http_port 8092TO : /tmp/contrail-dns.27955.http_port 2025-01-30 Thu 00:51:17:535.195 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: CONNECT TO COLLECTOR: 1 2025-01-30 Thu 00:51:17:535.369 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: Idle 2025-01-30 Thu 00:51:17:535.690 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: No Client: 1738198277535533 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:17:535.896 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: Logging: DISABLED -> ENABLED 2025-01-30 Thu 00:51:17:535.919 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-01-30 Thu 00:51:17:540.423 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Processing scm::EvStart in state Idle 2025-01-30 Thu 00:51:17:540.492 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Disconnect 2025-01-30 Thu 00:51:17:540.634 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Processing scm::EvCollectorUpdate in state Disconnect 2025-01-30 Thu 00:51:17:540.921 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Connect : Start Connect timer 10.0.0.36:8086 2025-01-30 Thu 00:51:17:541.079 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:541.248 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: SANDESH: Send FAILED: 1738198277540611 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:17:541.302 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:17:541.321 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:541.463 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: SANDESH: Send FAILED: 1738198277540724 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:17:541.481 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:17:541.504 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:541.642 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: SANDESH: Send FAILED: 1738198277541024 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:17:541.660 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:17:672.347 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.20.0.5:8093 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-01-30 Thu 00:51:17:672.538 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been started controller/src/dns/main.cc 380 2025-01-30 Thu 00:51:17:673.055 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 295 2025-01-30 Thu 00:51:17:673.887 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:673.950 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198277673203 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-01-30 Thu 00:51:17:673.967 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:17:673.999 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 159 2025-01-30 Thu 00:51:17:674.016 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 168 2025-01-30 Thu 00:51:17:869.619 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:869.683 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198277869513 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-01-30 Thu 00:51:17:869.694 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:17:869.865 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 152 2025-01-30 Thu 00:51:17:869.879 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 300 2025-01-30 Thu 00:51:17:869.929 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 578 2025-01-30 Thu 00:51:17:869.940 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 85 2025-01-30 Thu 00:51:17:869.972 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:870.033 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: SANDESH: Send FAILED: 1738198277869910 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down ], ] ] ] 2025-01-30 Thu 00:51:17:870.047 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:17:901.174 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 93 2025-01-30 Thu 00:51:17:904.448 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 102 2025-01-30 Thu 00:51:17:904.511 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 108 2025-01-30 Thu 00:51:17:905.352 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:17:905.401 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: SANDESH: Send FAILED: 1738198277904586 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:17:905.413 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:17:905.535 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:905.555 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 391 2025-01-30 Thu 00:51:17:916.772 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:920.166 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:939.125 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:940.829 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:942.762 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:945.008 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:946.760 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:947.839 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:950.131 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:951.360 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:952.778 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:955.978 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:957.784 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:958.846 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:960.660 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:961.630 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:962.902 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:969.528 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:971.533 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:972.844 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:977.382 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:980.170 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:981.244 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:984.948 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:985.922 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:986.871 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:992.635 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:993.672 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:17:995.323 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:010.812 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:012.327 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:013.432 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:029.076 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:031.005 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:032.557 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:035.792 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:037.985 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:038.952 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:040.879 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:042.777 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:043.946 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:045.978 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:047.158 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:048.783 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:051.350 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:052.643 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:054.207 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:059.347 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:060.455 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:061.768 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:065.145 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:066.446 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:067.858 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:085.841 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:196.044 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:206.354 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:225.690 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:228.342 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:230.963 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:242.143 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:244.027 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:249.795 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:267.884 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:269.858 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:281.942 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:285.496 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:288.036 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:289.390 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:299.153 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:302.184 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:303.887 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:336.180 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:338.001 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:339.178 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:353.649 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:355.641 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:358.621 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:374.271 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:375.545 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:377.204 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:398.027 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:399.474 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:401.664 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:407.909 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:413.386 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:425.754 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:450.707 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:452.764 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:462.302 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:469.207 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:470.711 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:472.097 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:487.842 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:489.821 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:493.598 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:507.260 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:508.401 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:516.317 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:518.148 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:529.268 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:530.677 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:546.818 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:550.064 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:551.910 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:556.784 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:558.024 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:564.260 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:574.305 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:578.322 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:581.641 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:588.789 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:590.748 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:593.299 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:598.059 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:599.462 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:603.595 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:614.138 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:615.506 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:619.471 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624149886720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:619.947 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:620.238 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:621.587 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:622.171 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624074372864, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:622.678 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:623.054 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 556 2025-01-30 Thu 00:51:18:623.462 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 552 2025-01-30 Thu 00:51:18:623.494 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 191 2025-01-30 Thu 00:51:18:623.685 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 219 2025-01-30 Thu 00:51:18:623.786 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:18:623.822 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: SANDESH: Send FAILED: 1738198278623531 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:18:623.832 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:18:629.842 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:631.849 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:631.917 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:631.936 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:631.952 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:631.970 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:631.983 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.005 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.017 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.030 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5210-64c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.051 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx240h-poe controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.061 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.077 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.089 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.102 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.129 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.146 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.165 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5800 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.179 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.203 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.217 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-srx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.232 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-srx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.243 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.258 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.269 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-aa controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.290 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.310 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5400 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.321 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.334 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx1500 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.344 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.359 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.373 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.386 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4100 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.397 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.412 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vsrx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.423 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.437 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4200 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.448 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.461 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5600 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.472 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.485 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4600 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.496 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.512 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.527 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.540 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:image_upgrade_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.576 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.591 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.609 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.622 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-32c-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.633 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:check_multicast_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.654 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.667 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.683 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.696 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_mac_mob_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.718 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.759 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2010 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.775 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5120:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.788 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5120 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.800 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.820 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.841 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.858 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.881 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.895 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.913 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.926 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx204 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.939 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.955 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.969 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:infra-bms-access controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:632.980 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:632.994 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:telemetry controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:633.004 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:633.019 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:633.032 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:overlay-bgp controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:633.043 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:633.059 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:633.070 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:633.086 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:633.098 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-overlay-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:633.115 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:633.127 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:633.139 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:633.154 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:633.966 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:634.081 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.149 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.171 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:device-functional-group controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.198 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.220 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.245 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.273 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.312 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.335 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 21a9b029-55ac-43e0-ab1b-8346e6af347f controller/src/ifmap/client/config_json_parser.cc 217 2025-01-30 Thu 00:51:18:634.345 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.353 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 21a9b029-55ac-43e0-ab1b-8346e6af347f controller/src/ifmap/client/config_json_parser.cc 217 2025-01-30 Thu 00:51:18:634.493 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.540 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.598 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-48s-4c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.621 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.645 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.664 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.695 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.729 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:rma_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.776 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.802 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.845 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.879 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.917 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.942 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:vn-interconnect controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:634.969 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:634.995 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l2-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.014 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.042 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.077 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.101 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.130 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.156 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:underlay-ip-clos controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.175 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.217 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.237 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.253 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 71aea6e1-4554-4442-8b0e-d06788cd7c08 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-30 Thu 00:51:18:635.263 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.349 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.389 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48y-8c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.414 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Spine-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.451 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.486 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.504 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.524 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.542 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.561 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.603 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.626 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.643 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:port-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.655 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.671 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:firewall controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.683 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.700 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.717 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.741 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.766 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.792 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-access controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.814 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.842 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.865 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:erb-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:635.887 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.906 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.923 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.940 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.957 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.974 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:635.991 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.009 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.029 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.054 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.077 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:erb-ucast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.102 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.129 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.153 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.174 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.217 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.243 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-36q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.257 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.274 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.287 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.303 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.315 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.331 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vqfx-10000 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.342 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.357 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-60c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.368 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.383 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-72q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.396 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.417 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.432 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-mx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.457 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.473 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx240 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.485 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.501 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx10003 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.513 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.528 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx480 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.540 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.554 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.579 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.594 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.605 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.620 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.634 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.655 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.678 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2020 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.697 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.713 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx960 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.724 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.739 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vmx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.751 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.765 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.778 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.794 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.811 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.827 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.850 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.866 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-access-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.886 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.901 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.930 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.953 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:636.975 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-48y controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:636.998 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.025 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.055 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.078 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.096 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.120 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.150 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.174 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.193 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.216 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.239 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.262 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.279 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.300 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.315 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.339 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.354 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.377 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.400 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.420 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.435 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.446 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.460 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.475 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.488 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.500 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.525 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.584 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:existing_fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.641 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.665 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.698 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.721 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-4 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.750 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.784 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating grpc-profile:default-domain:default-project:grpc-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.808 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.830 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.859 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.890 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:637.918 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.953 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:637.979 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:test_overlay_connectivity_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:638.019 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:638.043 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:638.094 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:638.115 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:638.132 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:_internal_ipam_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:638.160 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:638.188 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:638.225 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:638.256 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_interface_details_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:638.296 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:638.317 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hardware_inventory_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:638.349 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:638.374 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_device_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:638.423 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:639.524 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:640.826 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-32c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:640.883 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:640.919 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:640.946 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_role_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:640.986 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:641.014 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-spine:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:641.039 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:641.059 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:641.094 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-properties:default-global-system-config:config_property controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:641.122 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-properties controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:644.779 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:644.850 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:644.875 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_server_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:644.907 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:644.992 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_deactivate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:645.022 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:645.095 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:cli_sync_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:645.124 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:645.176 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-5 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:645.199 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:645.220 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating snmp-profile:default-domain:default-project:snmp-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:645.238 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:645.305 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:645.347 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:647.664 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-management-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:647.724 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:647.750 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Leaf-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:647.780 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:647.806 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:647.824 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:647.854 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:647.878 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:647.905 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:647.930 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:647.962 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:647.981 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:648.001 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.025 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.045 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.066 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.098 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.118 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.136 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.157 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.175 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.192 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.208 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:648.223 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.242 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.258 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:648.286 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.305 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:648.323 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.343 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-fabric-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:648.355 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.369 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-6 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:648.389 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:648.408 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating netconf-profile:default-domain:default-project:netconf-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:648.420 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.142 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624074372864, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:649.336 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:649.409 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.462 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.501 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.542 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.587 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-client controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:649.609 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.665 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.720 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:649.757 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.797 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.833 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.910 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:649.953 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.011 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.053 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.083 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.151 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.205 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-mcast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:650.228 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.286 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.320 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.357 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:650.417 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.504 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:650.539 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.595 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.642 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.670 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.702 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.727 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.753 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.772 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:topology_discovery_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:650.805 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.827 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:650.847 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.866 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.885 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.905 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.925 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.941 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:650.954 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:650.974 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:server_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.001 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.020 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.045 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.068 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.083 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.102 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.121 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.138 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.157 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.176 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.192 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.209 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.224 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.243 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.258 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dci-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.270 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.343 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.363 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.380 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.399 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:pnf-service-chaining controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.418 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.438 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.452 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.472 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.497 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:search_ip_mac_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.521 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.535 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.549 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.582 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.599 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:node_profile_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.624 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:651.638 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:651.655 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:653.414 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:655.204 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:655.254 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:655.275 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:655.755 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:655.780 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:655.799 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:655.818 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:655.835 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:655.851 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:655.872 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:655.893 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:655.912 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:655.948 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:655.963 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:vcenter_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:655.991 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.007 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.034 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.055 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.078 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.091 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hitless_upgrade_strategy_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.114 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.128 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.164 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.187 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.203 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.219 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.234 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.248 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.267 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.297 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.326 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.347 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.388 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.406 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:route-reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.418 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.436 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.450 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-pnf-servicechain-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.471 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.488 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.506 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.525 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Gateway-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.543 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.561 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.605 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.622 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.639 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.654 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:pnf-servicechain controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.665 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.685 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.698 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.714 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.730 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.746 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.763 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.780 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.796 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.811 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.827 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.843 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.859 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.875 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.888 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.906 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.919 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.937 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.953 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:656.970 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:656.986 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:657.009 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:657.023 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:657.040 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:657.061 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.148 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:658.339 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-mx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:658.397 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.432 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.451 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:658.477 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.519 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:_internal_vn_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:658.548 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.586 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:default-project:_internal_ipam_ipv6_link_local,default-domain:default-project:_internal_vn_ipv6_link_local) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:658.610 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.627 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.648 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:658.670 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.693 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.716 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.736 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.761 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:658.791 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.809 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:658.832 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.851 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-all-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:658.864 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.880 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:658.904 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.932 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:658.954 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-ebgp-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:658.979 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.008 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.034 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.058 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.076 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:659.099 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.116 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:659.140 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.162 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.181 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.200 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.219 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.237 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.255 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.273 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.313 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.333 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.349 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:659.370 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.389 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48t-6c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:659.418 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.454 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.473 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:659.494 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.517 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.535 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:659.553 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.580 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.599 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.616 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:659.640 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.071 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.124 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.150 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.170 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.188 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.207 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.223 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.239 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.256 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.273 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.292 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.311 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.327 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.347 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.363 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.384 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.408 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.438 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.461 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.483 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.500 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.520 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.535 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.557 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.584 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L2-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.608 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.628 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.642 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.661 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.681 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.700 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.718 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.736 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.756 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.773 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.791 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.806 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.822 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.837 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.853 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.870 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.887 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.901 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.918 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:661.932 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5220:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.946 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5220 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:661.957 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:662.909 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624149886720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:663.056 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:663.119 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.151 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.170 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:663.194 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.215 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.340 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:663.376 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.397 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:663.444 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:663.467 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.484 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-leaf:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:663.506 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.523 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:663.543 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.681 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:role_assignment_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:663.710 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.770 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:663.789 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.811 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.833 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.853 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.872 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.889 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.909 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.926 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.943 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.960 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.979 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:663.997 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.021 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.038 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:664.056 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.074 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:664.091 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_chassis_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:664.120 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.136 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:664.154 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.175 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.192 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.209 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.226 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.245 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.262 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.278 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.295 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.315 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.332 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.351 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-3 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:664.373 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:664.397 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:669.876 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:669.942 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.001 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.038 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Lean-Spine-with-Route-Reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.063 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.086 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.105 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.133 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.150 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-peer-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.175 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.201 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.226 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.243 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.269 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.293 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.320 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_os_computes_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.348 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.367 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:container_cleanup_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.390 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.411 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.431 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-128c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.446 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.464 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.495 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.525 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.552 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.583 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.608 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.628 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.644 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.660 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.686 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.703 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.720 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.737 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.757 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.777 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.792 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.817 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:670.832 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_ops_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:670.859 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:676.662 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:18:678.216 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:678.274 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.305 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:678.335 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.354 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:ztp_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:678.392 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.432 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.452 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Storage-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:678.481 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.502 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.520 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:678.539 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.553 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:erb-leaf:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:678.583 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.613 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.632 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-32cd controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:678.645 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.661 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.681 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.697 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:678.714 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:678.732 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.761 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.786 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.814 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.839 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.859 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.878 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.895 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.914 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.933 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.949 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:678.974 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:678.992 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:51:18:679.009 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:679.027 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:679.045 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:679.064 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:679.085 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:679.103 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:679.121 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:51:18:679.266 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: EndOfRib point was reached, IF-MAP objects have been created controller/src/dns/main.cc 86 2025-01-30 Thu 00:51:18:679.284 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS.0, counting 0 elements controller/src/dns/main.cc 98 2025-01-30 Thu 00:51:18:679.316 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS_record.0, counting 0 elements controller/src/dns/main.cc 98 2025-01-30 Thu 00:51:18:679.326 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.network_ipam.0, counting 3 elements controller/src/dns/main.cc 98 2025-01-30 Thu 00:51:18:679.335 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_network_network_ipam.0, counting 1 elements controller/src/dns/main.cc 98 2025-01-30 Thu 00:51:18:679.345 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.global_qos_config.0, counting 1 elements controller/src/dns/main.cc 98 2025-01-30 Thu 00:51:18:679.354 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: VnniConfig has been updated after the bulk sync, the number of elements: 1 controller/src/dns/main.cc 109 2025-01-30 Thu 00:51:18:679.363 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: IpamConfig has been updated after the bulk sync, the number of elements: 3 controller/src/dns/main.cc 120 2025-01-30 Thu 00:51:18:679.371 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 131 2025-01-30 Thu 00:51:18:679.379 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsRecordConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 142 2025-01-30 Thu 00:51:18:679.388 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: GlobalQosConfig has been updated after the bulk sync controller/src/dns/main.cc 152 2025-01-30 Thu 00:51:18:679.443 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 159 2025-01-30 Thu 00:51:18:679.454 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 168 2025-01-30 Thu 00:51:18:681.787 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:18:681.845 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: SANDESH: Send FAILED: 1738198278679425 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-01-30 Thu 00:51:18:681.856 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:18:754.549 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 152 2025-01-30 Thu 00:51:18:754.622 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624166680320, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 219 2025-01-30 Thu 00:51:18:754.658 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:18:754.669 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:18:754.821 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named up; DNS is operational controller/src/dns/mgr/dns_mgr.cc 737 2025-01-30 Thu 00:51:18:754.591 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:18:755.222 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: SANDESH: Send FAILED: 1738198278754500 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:18:755.232 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:18:755.244 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:18:755.264 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:18:755.436 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:18:755.478 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Idle 2025-01-30 Thu 00:51:18:755.550 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:18:755.729 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: SANDESH: Send FAILED: 1738198278755378 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 870, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:18:755.749 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:18:755.761 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:18:755.784 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: SANDESH: Send FAILED: 1738198278755407 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:18:755.794 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:18:755.803 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:18:755.854 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:18:756.032 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: SANDESH: Send FAILED: 1738198278755537 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 871, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:18:756.054 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:19:322.177 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:423.545 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:475.437 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:649.752 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:730.037 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624074372864, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:755.579 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:51:19:755.891 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Connect : Start Connect timer 10.0.0.40:8086 2025-01-30 Thu 00:51:19:756.004 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:19:756.037 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198279755642 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.40:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:19:756.047 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:19:756.057 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:19:756.230 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198279755990 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 157 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 876, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 13, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:19:756.254 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:19:756.285 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:19:756.294 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:19:756.335 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:19:756.345 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:19:756.646 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:19:756.684 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Idle 2025-01-30 Thu 00:51:19:756.753 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:19:756.920 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: SANDESH: Send FAILED: 1738198279756595 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 157 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 876, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 15, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:19:756.939 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:19:756.950 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:19:756.973 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: SANDESH: Send FAILED: 1738198279756623 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:19:756.983 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:19:756.992 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:19:757.013 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:19:757.171 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: SANDESH: Send FAILED: 1738198279756740 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 157 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 877, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 15, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:19:757.183 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:19:810.308 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:51:19:867.990 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been done (the DB has been synced with named) controller/src/dns/mgr/dns_mgr.cc 455 2025-01-30 Thu 00:51:21:756.836 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:51:21:757.253 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Connect : Start Connect timer 10.0.0.43:8086 2025-01-30 Thu 00:51:21:757.438 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:21:757.477 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SANDESH: Send FAILED: 1738198281756945 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.43:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:21:757.488 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:21:757.500 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:21:757.557 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:21:757.608 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:21:757.699 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SANDESH: Send FAILED: 1738198281757410 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 879, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:21:757.726 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:21:757.738 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:21:757.746 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:21:757.856 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:21:757.897 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Idle 2025-01-30 Thu 00:51:21:757.961 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:21:758.129 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SANDESH: Send FAILED: 1738198281757807 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 879, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:21:758.148 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:21:758.159 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:21:758.182 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SANDESH: Send FAILED: 1738198281757831 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:21:758.191 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:21:758.199 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:21:758.220 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:21:758.385 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SANDESH: Send FAILED: 1738198281757951 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 880, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:21:758.405 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:25:758.046 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:51:25:758.388 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Connect : Start Connect timer 10.0.0.36:8086 2025-01-30 Thu 00:51:25:758.583 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:25:758.645 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: SANDESH: Send FAILED: 1738198285758152 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:25:758.667 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:25:758.681 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:25:758.883 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:25:758.912 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:25:759.017 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: SANDESH: Send FAILED: 1738198285758557 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 880, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 23, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:25:759.046 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:25:759.063 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:25:759.074 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:25:759.238 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:25:759.282 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Idle 2025-01-30 Thu 00:51:25:759.415 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:25:759.715 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: SANDESH: Send FAILED: 1738198285759176 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 880, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:25:759.743 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:25:759.761 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:25:759.796 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: SANDESH: Send FAILED: 1738198285759208 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:25:759.806 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:25:759.818 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:25:759.849 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:25:760.115 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: SANDESH: Send FAILED: 1738198285759400 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 881, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 25, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:25:760.144 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:33:759.457 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:51:33:759.809 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Connect : Start Connect timer 10.0.0.40:8086 2025-01-30 Thu 00:51:33:759.832 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:33:759.868 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:33:759.966 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:33:760.011 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198293759576 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.40:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:33:760.022 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:33:760.032 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:33:760.040 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:33:760.148 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:33:760.184 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Idle 2025-01-30 Thu 00:51:33:760.252 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:33:760.461 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198293759945 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 881, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:33:760.481 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:33:760.493 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:33:760.700 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198293760097 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 881, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 29, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:33:760.723 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:33:760.734 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:33:760.759 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198293760124 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:33:760.766 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:33:760.778 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:33:760.800 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:33:760.991 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198293760240 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 882, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 29, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:33:761.009 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:47:536.030 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:47:536.140 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: SANDESH: Send FAILED: 1738198307535855 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 33 dequeues = 33 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 49 dequeues = 49 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198293760183 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198293760798 ] max_sm_queue_count = 5 ] 2025-01-30 Thu 00:51:47:536.168 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:47:536.180 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:47:536.427 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: SANDESH: Send FAILED: 1738198307535986 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 882, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:47:536.454 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:49:760.338 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:51:49:760.659 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Connect : Start Connect timer 10.0.0.43:8086 2025-01-30 Thu 00:51:49:760.839 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:49:760.877 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: SANDESH: Send FAILED: 1738198309760435 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.43:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:49:760.887 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:49:760.897 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:51:49:761.069 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: SANDESH: Send FAILED: 1738198309760820 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 882, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:49:761.095 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:49:761.134 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:51:49:761.144 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:51:49:761.186 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:51:49:761.199 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:51:49:761.320 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:51:49:761.354 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Idle 2025-01-30 Thu 00:51:49:761.420 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:49:761.581 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198309761276 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 882, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:49:761.599 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:51:49:761.611 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:49:761.648 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198309761301 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:51:49:761.656 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:51:49:761.665 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:51:49:761.687 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:51:49:761.842 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: SANDESH: Send FAILED: 1738198309761408 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 883, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:51:49:761.857 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:17:536.362 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:17:536.475 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: SANDESH: Send FAILED: 1738198337536166 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 40 dequeues = 40 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 59 dequeues = 59 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198309761352 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198309761685 ] max_sm_queue_count = 5 ] 2025-01-30 Thu 00:52:17:536.505 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:17:536.517 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:17:536.715 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: SANDESH: Send FAILED: 1738198337536306 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 883, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:17:536.731 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:17:881.517 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:17:881.584 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: SANDESH: Send FAILED: 1738198337881398 [SYS_NOTICE]: UveDnsInfo: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 start_time = 1738198277672489 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-27 00:09:56.738111","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7562-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.36:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.5, ] ] ] 2025-01-30 Thu 00:52:17:881.607 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: UveDnsInfo 2025-01-30 Thu 00:52:19:761.473 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:52:19:761.783 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Connect : Start Connect timer 10.0.0.36:8086 2025-01-30 Thu 00:52:19:762.017 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:52:19:762.066 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SANDESH: Send FAILED: 1738198339761591 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:52:19:762.082 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:52:19:762.094 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:52:19:762.245 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:52:19:762.277 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:52:19:762.285 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SANDESH: Send FAILED: 1738198339761993 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 883, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 43, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:19:762.312 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:19:762.323 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:52:19:762.331 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:52:19:762.447 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:52:19:762.487 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Idle 2025-01-30 Thu 00:52:19:762.555 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:19:762.878 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SANDESH: Send FAILED: 1738198339762394 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 883, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:19:762.912 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:19:762.931 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:19:762.969 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SANDESH: Send FAILED: 1738198339762418 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:52:19:762.986 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:52:19:763.000 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:52:19:763.031 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:19:763.283 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SANDESH: Send FAILED: 1738198339762545 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 158 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 448 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 252 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 884, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:19:763.331 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:24:714.070 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:52:24:714.247 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:52:24:714.292 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:52:24:836.124 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:52:24:836.293 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:52:24:836.334 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:52:24:867.375 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:52:24:867.584 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:52:24:867.665 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:52:47:536.733 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624149886720, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:47:536.838 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624149886720, Pid 28009]: SANDESH: Send FAILED: 1738198367536448 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 48 dequeues = 48 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 70 dequeues = 70 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198339762485 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198339763028 ] max_sm_queue_count = 5 ] 2025-01-30 Thu 00:52:47:536.862 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624149886720, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:47:536.872 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624149886720, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:47:537.053 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624149886720, Pid 28009]: SANDESH: Send FAILED: 1738198367536686 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 893, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 48, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:47:537.076 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624149886720, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:49:762.621 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:52:49:762.907 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Connect : Start Connect timer 10.0.0.40:8086 2025-01-30 Thu 00:52:49:763.009 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:52:49:763.179 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:52:49:763.040 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:52:49:763.232 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: SANDESH: Send FAILED: 1738198369762719 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.40:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:52:49:763.242 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:52:49:763.252 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:52:49:763.464 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: SANDESH: Send FAILED: 1738198369763023 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.40:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 893, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 50, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:49:763.490 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:49:763.502 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:52:49:763.510 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:52:49:763.633 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:52:49:763.681 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Idle 2025-01-30 Thu 00:52:49:763.749 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:49:763.936 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: SANDESH: Send FAILED: 1738198369763587 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 893, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:49:763.954 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:52:49:763.964 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:49:763.988 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: SANDESH: Send FAILED: 1738198369763611 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:52:49:763.999 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:52:49:764.008 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:52:49:764.029 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:52:49:764.198 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: SANDESH: Send FAILED: 1738198369763739 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 894, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:52:49:764.214 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:17:537.078 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:17:537.199 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: SANDESH: Send FAILED: 1738198397536870 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 55 dequeues = 55 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 80 dequeues = 80 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198369763680 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198369764027 ] max_sm_queue_count = 5 ] 2025-01-30 Thu 00:53:17:537.216 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:17:537.225 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:17:537.419 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: SANDESH: Send FAILED: 1738198397537035 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 894, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 55, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:17:537.443 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:19:763.828 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:53:19:764.085 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Connect : Start Connect timer 10.0.0.43:8086 2025-01-30 Thu 00:53:19:764.214 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:53:19:764.252 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: SANDESH: Send FAILED: 1738198399763918 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.43:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:53:19:764.262 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:53:19:764.271 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:53:19:764.344 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-30 Thu 00:53:19:764.384 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: -(-1):EvTcpConnectFail 2025-01-30 Thu 00:53:19:764.472 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: SANDESH: Send FAILED: 1738198399764198 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.43:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 894, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 57, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:19:764.492 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:19:764.503 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvTcpConnectFail in state Connect 2025-01-30 Thu 00:53:19:764.511 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Connect : EvTcpConnectFail 2025-01-30 Thu 00:53:19:764.617 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-30 Thu 00:53:19:764.649 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Idle 2025-01-30 Thu 00:53:19:764.728 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:19:764.908 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: SANDESH: Send FAILED: 1738198399764569 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 894, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:19:764.926 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:19:764.937 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:19:764.960 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: SANDESH: Send FAILED: 1738198399764593 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:53:19:764.967 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:53:19:764.977 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-30 Thu 00:53:19:764.999 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:19:765.185 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: SANDESH: Send FAILED: 1738198399764717 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 161 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 451 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 255 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 895, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:19:765.204 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:23:159.097 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:23:159.325 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:23:159.401 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:23:194.407 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:23:194.569 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:23:194.618 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624070174464, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:23:289.945 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:23:290.192 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624074372864, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:23:290.254 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624074372864, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:46:731.645 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624074372864, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:46:731.846 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624074372864, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:46:731.886 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624074372864, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:46:864.729 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:46:864.914 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:46:864.961 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:46:984.498 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624175077120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:53:46:984.717 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:53:46:984.784 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:53:47:537.430 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:47:537.565 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: SANDESH: Send FAILED: 1738198427537195 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 62 dequeues = 62 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 90 dequeues = 90 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198399764648 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198399764997 ] max_sm_queue_count = 5 ] 2025-01-30 Thu 00:53:47:537.604 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:47:537.618 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Processing scm::EvSandeshSend in state Idle 2025-01-30 Thu 00:53:47:537.941 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: SANDESH: Send FAILED: 1738198427537376 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 913, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 62, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:47:537.971 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624183473920, Pid 28009]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:49:764.768 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-30 Thu 00:53:49:764.997 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Connect : Start Connect timer 10.0.0.36:8086 2025-01-30 Thu 00:53:49:765.131 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:53:49:765.166 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: SANDESH: Send FAILED: 1738198429764849 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:53:49:765.176 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-30 Thu 00:53:49:765.186 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Processing scm::EvSandeshSend in state Connect 2025-01-30 Thu 00:53:49:765.370 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: SANDESH: Send FAILED: 1738198429765110 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 913, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 64, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:49:765.393 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-30 Thu 00:53:49:768.404 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.40:55340::10.0.0.36:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-30 Thu 00:53:49:768.435 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: 10.0.0.40:55340::10.0.0.36:8086(-1) OnSessionEvent TCP Connected 2025-01-30 Thu 00:53:49:768.444 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: 10.0.0.40:55340::10.0.0.36:8086(-1):EvTcpConnected 2025-01-30 Thu 00:53:49:768.506 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvTcpConnected in state Connect 2025-01-30 Thu 00:53:49:768.536 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-30 Thu 00:53:49:768.577 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ClientInit 2025-01-30 Thu 00:53:49:768.602 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2668-3:contrail-dns:0:Control count 1 2025-01-30 Thu 00:53:49:768.752 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvSandeshSend in state ClientInit 2025-01-30 Thu 00:53:49:768.766 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-30 Thu 00:53:49:768.801 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: SANDESH: Send FAILED: 1738198429768568 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-30 Thu 00:53:49:768.809 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Received UVE message in wrong state : NodeStatusUVE 2025-01-30 Thu 00:53:49:768.818 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvSandeshSend in state ClientInit 2025-01-30 Thu 00:53:49:768.825 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-30 Thu 00:53:49:768.837 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Processing scm::EvSandeshSend in state ClientInit 2025-01-30 Thu 00:53:49:768.843 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-30 Thu 00:53:49:769.014 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: SANDESH: Send FAILED: 1738198429768739 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 914, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-30 Thu 00:53:49:769.031 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-30 Thu 00:53:49:772.266 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624170878720, Pid 28009]: OnMessage control in state: ClientInit 2025-01-30 Thu 00:53:49:772.323 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-01-30 Thu 00:53:49:772.346 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: ClientInit : EvSandeshMessageRecv 2025-01-30 Thu 00:53:49:772.380 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Received Ctrl Message with size 0 2025-01-30 Thu 00:53:49:772.400 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2668-3 start_time = 1738198277672489 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-27 00:09:56.738111","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7562-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.36:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.5, ] ] proxy seq 1 2025-01-30 Thu 00:53:49:772.414 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-01-30 Thu 00:53:49:772.649 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2668-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 28009 http_port = 8092 start_time = 1738198277535390 collector_name = collector_ip = 10.0.0.36:8086 collector_list= [ [ (*_iter40) = 10.0.0.36:8086, (*_iter40) = 10.0.0.40:8086, (*_iter40) = 10.0.0.43:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 62 dequeues = 62 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 90 dequeues = 90 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1738198399764648 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1738198399764997 ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 167 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 457 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 261 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 914, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 5 proxy seq 42 2025-01-30 Thu 00:53:49:772.690 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-01-30 Thu 00:53:49:772.716 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2668-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.36:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.36:9041, (*_iter6) = 10.0.0.43:9041, (*_iter6) = 10.0.0.40:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.36:5673, (*_iter6) = 10.0.0.43:5673, (*_iter6) = 10.0.0.40:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 26 2025-01-30 Thu 00:53:49:772.732 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-01-30 Thu 00:53:49:772.742 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-30 Thu 00:53:49:772.750 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-30 Thu 00:53:49:772.759 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-30 Thu 00:53:49:772.792 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: Established 2025-01-30 Thu 00:54:04:630.275 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:54:04:630.447 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:54:04:630.488 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624154085120, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:54:04:749.947 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:54:04:750.106 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:54:04:750.148 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:54:04:787.497 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:54:04:787.652 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2668-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:54:04:787.712 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:55:13:505.980 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:55258 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:55:13:657.587 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:42216 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:55:13:954.394 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:50342 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:55:14:366.852 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:50354 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:55:15:063.140 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:42348 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:55:15:440.290 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:42230 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 00:56:02:179.953 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624162481920, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:02:336.056 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:02:336.279 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2668-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:56:02:336.334 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:02:745.608 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:02:745.859 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2668-2:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:56:02:745.914 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:02:745.971 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:02:780.959 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624145688320, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:03:059.101 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:03:059.280 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2668-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:56:03:059.338 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624065976064, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:03:404.545 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 00:56:03:404.732 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2668-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-30 Thu 00:56:03:404.775 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:03:404.801 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624179275520, Pid 28009]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-30 Thu 00:56:03:472.530 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624158283520, Pid 28009]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-30 Thu 01:00:13:510.581 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:40002 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:00:13:658.185 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:44862 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:00:13:963.961 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:39036 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:00:14:369.790 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:39050 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:00:15:063.217 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:43508 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:00:15:450.089 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:44864 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:13:517.678 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:42526 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:13:666.502 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:35358 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:13:970.724 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:38106 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:14:372.870 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:38118 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:15:063.198 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:43636 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:05:15:445.631 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:35364 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:13:518.518 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:53458 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:13:667.566 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:43022 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:13:969.464 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:36758 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:14:380.035 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:36772 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:15:066.280 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:37426 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:10:15:446.121 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:43030 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:13:523.675 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:59404 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:13:674.615 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:44634 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:13:974.616 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:55386 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:14:378.310 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:55394 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:15:075.630 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:56294 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:15:15:450.480 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:44646 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:13:526.722 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:48240 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:13:677.937 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:56192 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:13:978.645 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:53242 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:14:379.931 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.5:53248 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:15:069.617 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.22:38336 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-30 Thu 01:20:15:450.679 UTC cn-jenkins-deploy-platform-ansible-os-2668-3 [Thread 140624339400832, Pid 28009]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.5:8092::10.20.0.18:56194 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254