2025-02-13 Thu 02:09:29:755.349 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:09:29:841.983 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650462791424, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:09:29:972.902 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:09:30:018.040 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:10:47:860.583 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:53722::10.0.0.46:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-13 Thu 02:10:47:860.674 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:53722::10.0.0.46:8086(-1):EvTcpClose 2025-02-13 Thu 02:10:47:860.749 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Processing scm::EvTcpClose in state Established 2025-02-13 Thu 02:10:47:860.782 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Established : EvTcpClose 2025-02-13 Thu 02:10:47:861.107 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Connect : Start Connect timer 10.0.0.12:8086 2025-02-13 Thu 02:10:47:861.327 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:10:47:861.671 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: SANDESH: Send FAILED: 1739412647860905 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Established successful_connections = 1 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = cn-jenkins-deploy-platform-ansible-os-2728-1. collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 220425 calls = 18 average_bytes = 12245 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1438, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 21, ] ] ] 2025-02-13 Thu 02:10:47:861.704 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:10:47:861.717 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:10:47:861.745 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: SANDESH: Send FAILED: 1739412647860955 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Established : EvTcpClose -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:10:47:861.754 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:10:47:861.764 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Processing scm::EvTcpDeleteSession in state Connect 2025-02-13 Thu 02:10:47:861.798 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:10:47:862.080 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: SANDESH: Send FAILED: 1739412647861301 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 1 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 220425 calls = 18 average_bytes = 12245 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1438, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 21, ] ] ] 2025-02-13 Thu 02:10:47:862.102 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:10:47:864.792 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.35:34382::10.0.0.12:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-02-13 Thu 02:10:47:864.824 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:34382::10.0.0.12:8086(-1) OnSessionEvent TCP Connected 2025-02-13 Thu 02:10:47:864.832 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:34382::10.0.0.12:8086(-1):EvTcpConnected 2025-02-13 Thu 02:10:47:868.550 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Processing scm::EvTcpConnected in state Connect 2025-02-13 Thu 02:10:47:868.582 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-13 Thu 02:10:47:868.633 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: ClientInit 2025-02-13 Thu 02:10:47:868.656 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2728-2:contrail-dns:0:Control count 2 2025-02-13 Thu 02:10:47:868.799 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:10:47:868.809 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-13 Thu 02:10:47:868.841 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: SANDESH: Send FAILED: 1739412647868623 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:10:47:868.850 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Received UVE message in wrong state : NodeStatusUVE 2025-02-13 Thu 02:10:47:868.858 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:10:47:868.865 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-13 Thu 02:10:47:868.877 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:10:47:868.884 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-13 Thu 02:10:47:869.151 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: SANDESH: Send FAILED: 1739412647868783 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 2 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 220425 calls = 18 average_bytes = 12245 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19, _iter59->first = sent _iter59->second = 21, ] ] ] 2025-02-13 Thu 02:10:47:874.586 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-13 Thu 02:10:47:900.565 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:34382::10.0.0.12:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-13 Thu 02:10:47:900.599 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:34382::10.0.0.12:8086(-1):EvTcpClose 2025-02-13 Thu 02:10:47:900.655 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvTcpClose in state ClientInit 2025-02-13 Thu 02:10:47:900.668 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ClientInit : EvTcpClose 2025-02-13 Thu 02:10:47:900.869 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Return to idle with 5000 2025-02-13 Thu 02:10:47:900.880 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Idle 2025-02-13 Thu 02:10:47:900.961 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:10:47:901.203 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: SANDESH: Send FAILED: 1739412647900804 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 2 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 222035 calls = 19 average_bytes = 11686 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21, _iter59->first = sent _iter59->second = 22, ] ] ] 2025-02-13 Thu 02:10:47:901.232 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:10:47:901.243 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:10:47:901.268 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: SANDESH: Send FAILED: 1739412647900853 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:10:47:901.275 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:10:47:901.283 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-13 Thu 02:10:47:901.315 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:10:47:901.554 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: SANDESH: Send FAILED: 1739412647900944 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 2 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 222035 calls = 19 average_bytes = 11686 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21, _iter59->first = sent _iter59->second = 22, ] ] ] 2025-02-13 Thu 02:10:47:901.587 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:10:52:901.097 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-13 Thu 02:10:52:901.347 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Connect : Start Connect timer 10.0.0.35:8086 2025-02-13 Thu 02:10:52:901.484 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:10:52:901.520 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: SANDESH: Send FAILED: 1739412652901161 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.35:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:10:52:901.530 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:10:52:901.540 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:10:52:901.786 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: SANDESH: Send FAILED: 1739412652901465 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 2 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 222035 calls = 19 average_bytes = 11686 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 24, _iter59->first = sent _iter59->second = 22, ] ] ] 2025-02-13 Thu 02:10:52:901.809 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:10:52:904.376 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.35:47384::10.0.0.35:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-02-13 Thu 02:10:52:904.404 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:47384::10.0.0.35:8086(-1) OnSessionEvent TCP Connected 2025-02-13 Thu 02:10:52:904.423 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:47384::10.0.0.35:8086(-1):EvTcpConnected 2025-02-13 Thu 02:10:52:904.492 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Processing scm::EvTcpConnected in state Connect 2025-02-13 Thu 02:10:52:904.524 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-13 Thu 02:10:52:904.568 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ClientInit 2025-02-13 Thu 02:10:52:904.587 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2728-2:contrail-dns:0:Control count 3 2025-02-13 Thu 02:10:52:904.725 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:10:52:904.736 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-13 Thu 02:10:52:904.762 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: SANDESH: Send FAILED: 1739412652904558 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.35:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:10:52:904.771 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Received UVE message in wrong state : NodeStatusUVE 2025-02-13 Thu 02:10:52:904.782 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:10:52:904.789 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-13 Thu 02:10:52:904.802 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:10:52:904.809 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-13 Thu 02:10:52:905.065 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: SANDESH: Send FAILED: 1739412652904709 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 3 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 222035 calls = 19 average_bytes = 11686 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26, _iter59->first = sent _iter59->second = 22, ] ] ] 2025-02-13 Thu 02:10:52:905.093 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-13 Thu 02:10:54:904.702 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: 10.0.0.35:8086 EvConnectTimerExpired in state ClientInit 2025-02-13 Thu 02:10:54:904.763 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvConnectTimerExpired in state ClientInit 2025-02-13 Thu 02:10:54:904.774 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ClientInit : EvConnectTimerExpired 2025-02-13 Thu 02:10:54:905.150 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Return to idle with 5000 2025-02-13 Thu 02:10:54:905.176 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Idle 2025-02-13 Thu 02:10:54:905.319 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:10:54:905.652 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: SANDESH: Send FAILED: 1739412654904884 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 3 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 223645 calls = 20 average_bytes = 11182 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28, _iter59->first = sent _iter59->second = 23, ] ] ] 2025-02-13 Thu 02:10:54:905.687 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:10:54:905.712 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:10:54:905.745 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: SANDESH: Send FAILED: 1739412654904925 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.35:8086, ] ] status = Down description = ClientInit : EvConnectTimerExpired ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:10:54:905.753 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:10:54:905.762 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-13 Thu 02:10:54:905.799 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:10:54:906.052 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: SANDESH: Send FAILED: 1739412654905293 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 3 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 223645 calls = 20 average_bytes = 11182 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28, _iter59->first = sent _iter59->second = 23, ] ] ] 2025-02-13 Thu 02:10:54:906.075 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:10:59:905.272 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-13 Thu 02:10:59:905.523 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Connect : Start Connect timer 10.0.0.46:8086 2025-02-13 Thu 02:10:59:905.670 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:10:59:905.702 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: SANDESH: Send FAILED: 1739412659905356 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:10:59:905.712 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:10:59:905.720 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:10:59:905.972 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: SANDESH: Send FAILED: 1739412659905652 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 3 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 223645 calls = 20 average_bytes = 11182 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 31, _iter59->first = sent _iter59->second = 23, ] ] ] 2025-02-13 Thu 02:10:59:905.996 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:10:59:908.085 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.35:58632::10.0.0.46:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-02-13 Thu 02:10:59:908.114 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:58632::10.0.0.46:8086(-1) OnSessionEvent TCP Connected 2025-02-13 Thu 02:10:59:908.122 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:58632::10.0.0.46:8086(-1):EvTcpConnected 2025-02-13 Thu 02:10:59:908.235 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvTcpConnected in state Connect 2025-02-13 Thu 02:10:59:908.260 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-13 Thu 02:10:59:908.304 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ClientInit 2025-02-13 Thu 02:10:59:908.322 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2728-2:contrail-dns:0:Control count 4 2025-02-13 Thu 02:10:59:908.463 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:10:59:908.478 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-13 Thu 02:10:59:908.508 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: SANDESH: Send FAILED: 1739412659908294 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:10:59:908.519 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Received UVE message in wrong state : NodeStatusUVE 2025-02-13 Thu 02:10:59:908.530 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:10:59:908.537 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-13 Thu 02:10:59:908.551 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:10:59:908.559 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-13 Thu 02:10:59:908.833 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: SANDESH: Send FAILED: 1739412659908449 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 223645 calls = 20 average_bytes = 11182 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 23, ] ] ] 2025-02-13 Thu 02:10:59:908.859 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-13 Thu 02:11:00:912.002 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.35:58632::10.0.0.46:8086(-1) < Read failed due to error system 104 : Connection reset by peer src/contrail-common/io/tcp_session.cc 507 2025-02-13 Thu 02:11:00:912.045 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.35:58632::10.0.0.46:8086(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-02-13 Thu 02:11:00:912.160 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:58632::10.0.0.46:8086(-1) OnSessionEvent TCP Connection Closed 2025-02-13 Thu 02:11:00:912.171 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:58632::10.0.0.46:8086(-1):EvTcpClose 2025-02-13 Thu 02:11:00:912.228 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: Processing scm::EvTcpClose in state ClientInit 2025-02-13 Thu 02:11:00:912.241 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: ClientInit : EvTcpClose 2025-02-13 Thu 02:11:00:912.454 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: Return to idle with 5000 2025-02-13 Thu 02:11:00:912.466 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: Idle 2025-02-13 Thu 02:11:00:912.541 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:00:912.780 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: SANDESH: Send FAILED: 1739412660912396 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:00:912.807 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:00:912.818 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:00:912.840 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: SANDESH: Send FAILED: 1739412660912436 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:11:00:912.848 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:11:00:912.856 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-13 Thu 02:11:00:912.885 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:00:913.127 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: SANDESH: Send FAILED: 1739412660912530 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:00:913.156 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:01:319.235 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:01:319.366 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412661319054 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 62 dequeues = 62 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 79 dequeues = 79 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739412660912465 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739412660912884 ] max_sm_queue_count = 5 ] 2025-02-13 Thu 02:11:01:319.382 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:01:319.393 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:01:319.650 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412661319191 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 38, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:01:319.675 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:05:912.576 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-13 Thu 02:11:05:912.791 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Connect : Start Connect timer 10.0.0.12:8086 2025-02-13 Thu 02:11:05:912.932 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:11:05:912.963 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: SANDESH: Send FAILED: 1739412665912653 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:11:05:912.973 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:11:05:912.982 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:11:05:913.221 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: SANDESH: Send FAILED: 1739412665912912 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:05:913.243 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:05:913.349 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: -(-1) OnSessionEvent TCP Connect Failed 2025-02-13 Thu 02:11:05:913.377 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: -(-1):EvTcpConnectFail 2025-02-13 Thu 02:11:05:913.408 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvTcpConnectFail in state Connect 2025-02-13 Thu 02:11:05:913.419 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Connect : EvTcpConnectFail 2025-02-13 Thu 02:11:05:913.617 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-02-13 Thu 02:11:05:914.629 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Idle 2025-02-13 Thu 02:11:05:914.756 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:05:915.023 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: SANDESH: Send FAILED: 1739412665913555 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 42, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:05:915.058 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:05:915.074 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:05:915.106 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: SANDESH: Send FAILED: 1739412665913593 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:11:05:915.121 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:11:05:915.135 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-13 Thu 02:11:05:915.171 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:05:915.428 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: SANDESH: Send FAILED: 1739412665914742 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1444, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 42, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:05:915.447 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:13:914.738 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-13 Thu 02:11:13:937.648 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Connect : Start Connect timer 10.0.0.35:8086 2025-02-13 Thu 02:11:13:937.792 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:11:13:937.822 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: SANDESH: Send FAILED: 1739412673937501 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.35:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:11:13:937.832 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:11:13:937.841 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:11:13:938.118 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: SANDESH: Send FAILED: 1739412673937769 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1444, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:13:938.147 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:13:938.547 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: -(-1) OnSessionEvent TCP Connect Failed 2025-02-13 Thu 02:11:13:938.583 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: -(-1):EvTcpConnectFail 2025-02-13 Thu 02:11:13:938.766 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvTcpConnectFail in state Connect 2025-02-13 Thu 02:11:13:938.790 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Connect : EvTcpConnectFail 2025-02-13 Thu 02:11:13:938.938 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-02-13 Thu 02:11:13:938.972 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Idle 2025-02-13 Thu 02:11:13:939.042 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:13:939.426 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: SANDESH: Send FAILED: 1739412673938879 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1444, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 47, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:13:939.457 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:13:939.471 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:13:939.496 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: SANDESH: Send FAILED: 1739412673938910 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:11:13:939.506 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:11:13:939.516 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-13 Thu 02:11:13:939.539 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:13:939.835 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: SANDESH: Send FAILED: 1739412673939025 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1445, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 47, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:13:939.866 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:29:939.143 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-13 Thu 02:11:29:939.448 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Connect : Start Connect timer 10.0.0.46:8086 2025-02-13 Thu 02:11:29:939.651 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:11:29:939.702 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: SANDESH: Send FAILED: 1739412689939235 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:11:29:939.716 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:11:29:939.730 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:11:29:940.220 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: SANDESH: Send FAILED: 1739412689939624 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1445, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 50, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:29:940.266 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:29:940.290 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: -(-1) OnSessionEvent TCP Connect Failed 2025-02-13 Thu 02:11:29:940.317 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: -(-1):EvTcpConnectFail 2025-02-13 Thu 02:11:29:940.390 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Processing scm::EvTcpConnectFail in state Connect 2025-02-13 Thu 02:11:29:940.403 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Connect : EvTcpConnectFail 2025-02-13 Thu 02:11:29:940.575 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-02-13 Thu 02:11:29:940.615 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Idle 2025-02-13 Thu 02:11:29:940.692 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:29:940.981 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: SANDESH: Send FAILED: 1739412689940521 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1445, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:29:941.015 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:29:941.036 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:29:941.063 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: SANDESH: Send FAILED: 1739412689940556 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:11:29:941.070 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:11:29:941.079 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-13 Thu 02:11:29:941.106 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:29:941.332 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: SANDESH: Send FAILED: 1739412689940678 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:29:941.365 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:31:319.553 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:31:319.665 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412691319384 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 79 dequeues = 79 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 105 dequeues = 105 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739412689940614 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739412689941104 ] max_sm_queue_count = 5 ] 2025-02-13 Thu 02:11:31:319.681 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:31:319.690 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:31:319.948 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412691319522 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 55, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:31:319.979 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:59:940.747 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-13 Thu 02:11:59:940.986 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Connect : Start Connect timer 10.0.0.12:8086 2025-02-13 Thu 02:11:59:941.157 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:11:59:941.217 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: SANDESH: Send FAILED: 1739412719940842 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:11:59:941.231 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:11:59:941.245 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:11:59:941.691 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: SANDESH: Send FAILED: 1739412719941135 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 57, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:59:941.735 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:59:941.881 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: -(-1) OnSessionEvent TCP Connect Failed 2025-02-13 Thu 02:11:59:941.896 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: -(-1):EvTcpConnectFail 2025-02-13 Thu 02:11:59:941.931 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvTcpConnectFail in state Connect 2025-02-13 Thu 02:11:59:941.962 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Connect : EvTcpConnectFail 2025-02-13 Thu 02:11:59:942.153 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-02-13 Thu 02:11:59:942.201 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Idle 2025-02-13 Thu 02:11:59:942.303 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:59:942.898 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: SANDESH: Send FAILED: 1739412719942082 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:59:942.942 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:11:59:942.962 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:59:943.000 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: SANDESH: Send FAILED: 1739412719942122 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:11:59:943.012 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:11:59:943.026 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-13 Thu 02:11:59:943.068 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:11:59:943.515 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: SANDESH: Send FAILED: 1739412719942286 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1447, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:11:59:943.543 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:12:01:319.807 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:12:01:319.911 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: SANDESH: Send FAILED: 1739412721319654 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 86 dequeues = 86 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 115 dequeues = 115 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739412719942199 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739412719943065 ] max_sm_queue_count = 5 ] 2025-02-13 Thu 02:12:01:319.926 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:12:01:319.934 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:12:01:320.203 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: SANDESH: Send FAILED: 1739412721319778 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1447, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 62, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:12:01:320.234 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:12:09:507.939 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:09:822.187 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:10:319.664 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:10:607.688 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:10:663.203 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:10:684.108 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:12:536.262 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:12:810.787 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:13:037.425 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:19:301.439 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:24:600.399 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:24:610.462 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:24:651.748 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:187.925 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:275.045 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:363.212 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:384.093 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:479.524 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:610.976 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:646.441 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:746.375 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:918.544 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:928.599 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:26:976.532 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:087.967 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:096.890 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:155.197 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:272.343 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:288.094 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:349.636 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:463.624 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:481.158 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:538.543 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:650.629 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:696.981 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:720.434 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:833.116 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:864.762 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:27:896.972 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:018.279 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:070.086 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:087.269 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:194.697 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:277.087 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:302.191 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:410.778 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:497.829 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:509.760 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:580.142 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:690.378 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:724.969 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:758.240 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:893.071 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:918.088 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:28:964.003 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:086.585 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:106.241 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650462791424, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:150.303 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650462791424, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:258.530 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650462791424, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:278.430 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:300.397 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:453.248 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:484.449 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:488.449 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:646.911 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:709.146 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:738.316 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:853.323 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:911.299 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:928.286 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:29:942.308 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-13 Thu 02:12:29:942.643 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Connect : Start Connect timer 10.0.0.35:8086 2025-02-13 Thu 02:12:29:942.674 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: -(-1) OnSessionEvent TCP Connect Failed 2025-02-13 Thu 02:12:29:942.706 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: -(-1):EvTcpConnectFail 2025-02-13 Thu 02:12:29:942.807 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:12:29:942.842 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412749942407 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.35:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:12:29:942.852 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:12:29:942.873 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvTcpConnectFail in state Connect 2025-02-13 Thu 02:12:29:942.882 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Connect : EvTcpConnectFail 2025-02-13 Thu 02:12:29:942.985 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-02-13 Thu 02:12:29:943.019 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Idle 2025-02-13 Thu 02:12:29:943.104 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:12:29:943.368 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412749942788 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.35:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 715 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1517, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 64, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:12:29:943.395 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:12:29:943.408 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:12:29:943.631 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412749942938 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 715 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1517, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 65, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:12:29:943.651 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:12:29:943.661 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:12:29:943.682 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412749942963 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:12:29:943.689 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:12:29:943.698 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvTcpDeleteSession in state Idle 2025-02-13 Thu 02:12:29:943.718 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:12:29:943.942 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412749943072 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 715 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1518, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 65, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:12:29:943.961 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:12:30:039.698 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:115.164 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:124.418 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650171324160, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:235.150 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:309.746 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:346.323 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650475386624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:463.251 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:521.710 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650179720960, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:540.871 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650462791424, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:662.451 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650162927360, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:754.025 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650462791424, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:30:775.010 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:31:320.165 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:12:31:320.316 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: SANDESH: Send FAILED: 1739412751319938 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 93 dequeues = 93 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 125 dequeues = 125 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739412749943018 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739412749943716 ] max_sm_queue_count = 5 ] 2025-02-13 Thu 02:12:31:320.345 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:12:31:320.357 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Processing scm::EvSandeshSend in state Idle 2025-02-13 Thu 02:12:31:320.613 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: SANDESH: Send FAILED: 1739412751320122 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 727 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1530, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 69, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:12:31:320.630 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:12:32:379.976 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650167125760, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:32:433.153 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:32:449.126 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:32:970.183 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:34240 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-02-13 Thu 02:12:33:482.446 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:37280 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-02-13 Thu 02:12:34:000.248 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:56984 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-02-13 Thu 02:12:36:340.899 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:38:422.163 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650381047552, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:42:498.341 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:50:129.208 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650462791424, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:52:255.354 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:54:199.564 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:12:58:460.140 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:44262 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-02-13 Thu 02:12:59:943.142 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-02-13 Thu 02:12:59:943.407 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: Connect : Start Connect timer 10.0.0.46:8086 2025-02-13 Thu 02:12:59:943.602 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:12:59:943.657 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SANDESH: Send FAILED: 1739412779943224 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:12:59:943.670 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:12:59:943.681 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:12:59:944.001 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SANDESH: Send FAILED: 1739412779943575 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 736 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 22 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1543, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 71, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:12:59:944.035 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:12:59:946.377 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.35:41258::10.0.0.46:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-02-13 Thu 02:12:59:946.408 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:41258::10.0.0.46:8086(-1) OnSessionEvent TCP Connected 2025-02-13 Thu 02:12:59:946.457 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: 10.0.0.35:41258::10.0.0.46:8086(-1):EvTcpConnected 2025-02-13 Thu 02:12:59:947.203 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvTcpConnected in state Connect 2025-02-13 Thu 02:12:59:947.222 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-13 Thu 02:12:59:947.266 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ClientInit 2025-02-13 Thu 02:12:59:947.280 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2728-2:contrail-dns:0:Control count 5 2025-02-13 Thu 02:12:59:947.428 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:12:59:947.439 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-13 Thu 02:12:59:947.470 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412779947257 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:12:59:947.487 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Received UVE message in wrong state : NodeStatusUVE 2025-02-13 Thu 02:12:59:947.496 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:12:59:947.503 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-13 Thu 02:12:59:947.515 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:12:59:947.521 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-13 Thu 02:12:59:947.755 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: SANDESH: Send FAILED: 1739412779947411 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 5 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 736 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 23 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1544, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 73, _iter59->first = sent _iter59->second = 24, ] ] ] 2025-02-13 Thu 02:12:59:947.775 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650458593024, Pid 86972]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-13 Thu 02:12:59:957.404 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:42612 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-02-13 Thu 02:12:59:989.001 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: OnMessage control in state: ClientInit 2025-02-13 Thu 02:12:59:989.077 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-02-13 Thu 02:12:59:989.094 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: ClientInit : EvSandeshMessageRecv 2025-02-13 Thu 02:12:59:989.131 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: Received Ctrl Message with size 0 2025-02-13 Thu 02:12:59:989.162 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2728-2 start_time = 1739412479304791 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-02-10 00:09:47.473443","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7710-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.46:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.6, ] ] proxy seq 1 2025-02-13 Thu 02:12:59:989.181 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-02-13 Thu 02:12:59:991.181 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 5 pid = 86972 http_port = 8092 start_time = 1739412478751819 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 225255 calls = 21 average_bytes = 10726 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 93 dequeues = 93 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 125 dequeues = 125 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1739412749943018 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1739412749943716 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 19 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 185120 calls = 16 average_bytes = 11570 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 736 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 23 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1544, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 73, _iter59->first = sent _iter59->second = 24, ] ] max_sm_queue_count = 5 proxy seq 54 2025-02-13 Thu 02:12:59:991.384 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-02-13 Thu 02:12:59:991.429 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 33 2025-02-13 Thu 02:12:59:991.451 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-02-13 Thu 02:12:59:991.468 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-02-13 Thu 02:12:59:991.479 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-02-13 Thu 02:12:59:991.490 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-02-13 Thu 02:12:59:991.562 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650376849152, Pid 86972]: Established 2025-02-13 Thu 02:13:00:028.783 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650631313536, Pid 86972]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:35960 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-02-13 Thu 02:13:09:051.308 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: OnMessage control in state: Established 2025-02-13 Thu 02:13:09:051.384 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Processing scm::EvSandeshMessageRecv in state Established 2025-02-13 Thu 02:13:09:051.395 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Established : EvSandeshMessageRecv 2025-02-13 Thu 02:13:09:051.439 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: Received Ctrl Message with size 3 2025-02-13 Thu 02:13:09:051.455 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: SyncAllMaps for DnsState:0 period 0 cycle 0 with seqno 1, total = 0 2025-02-13 Thu 02:13:09:051.466 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 57, total = 0 2025-02-13 Thu 02:13:09:051.476 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 35, total = 0 2025-02-13 Thu 02:13:09:051.487 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-02-13 Thu 02:13:09:051.494 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-02-13 Thu 02:13:09:051.501 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650175522560, Pid 86972]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-02-13 Thu 02:14:06:478.021 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650471188224, Pid 86972]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-02-13 Thu 02:14:19:693.712 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140650454394624, Pid 86972]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named down; DNS is not operational controller/src/dns/mgr/dns_mgr.cc 747 2025-02-13 Thu 02:14:50:383.008 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_INFO]: VersionInfoLog: {"build-info":[{"build-version":"nightly","build-time":"2025-02-13 00:23:58.688213","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7769-1.novalocal","build-id":"unknown","build-number":"unknown"}]} src/contrail-common/base/misc_utils.cc 41 2025-02-13 Thu 02:14:50:383.112 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: ROLE : Generator 2025-02-13 Thu 02:14:50:383.122 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: MODULE : contrail-dns 2025-02-13 Thu 02:14:50:383.128 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-2728-2 2025-02-13 Thu 02:14:50:383.133 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: NODE TYPE : Control 2025-02-13 Thu 02:14:50:383.139 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: INSTANCE ID : 0 2025-02-13 Thu 02:14:50:383.145 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: HTTP SERVER PORT : 8092 2025-02-13 Thu 02:14:50:383.150 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-02-13 Thu 02:14:50:383.844 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: HTTP Introspect Init 2025-02-13 Thu 02:14:50:383.971 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8092 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-13 Thu 02:14:50:384.040 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: Sandesh Http Server Port: 8092 2025-02-13 Thu 02:14:50:384.087 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: NOT Writing http_port 8092TO : /tmp/contrail-dns.113556.http_port 2025-02-13 Thu 02:14:50:384.097 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: CONNECT TO COLLECTOR: 1 2025-02-13 Thu 02:14:50:384.178 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: Idle 2025-02-13 Thu 02:14:50:384.373 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: No Client: 1739412890384272 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 113620 http_port = 8092 start_time = 1739412890384188 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-13 Thu 02:14:50:384.515 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: Logging: DISABLED -> ENABLED 2025-02-13 Thu 02:14:50:384.529 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-02-13 Thu 02:14:50:384.890 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Processing scm::EvStart in state Idle 2025-02-13 Thu 02:14:50:384.936 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Disconnect 2025-02-13 Thu 02:14:50:387.408 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Processing scm::EvCollectorUpdate in state Disconnect 2025-02-13 Thu 02:14:50:387.634 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Connect : Start Connect timer 10.0.0.46:8086 2025-02-13 Thu 02:14:50:387.730 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:14:50:387.827 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: SANDESH: Send FAILED: 1739412890387386 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 113620 http_port = 8092 start_time = 1739412890384188 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-13 Thu 02:14:50:387.846 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:14:50:387.856 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:14:50:387.927 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: SANDESH: Send FAILED: 1739412890387487 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 113620 http_port = 8092 start_time = 1739412890384188 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-13 Thu 02:14:50:387.987 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:14:50:388.003 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:14:50:388.083 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: SANDESH: Send FAILED: 1739412890387717 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 113620 http_port = 8092 start_time = 1739412890384188 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-13 Thu 02:14:50:388.093 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-02-13 Thu 02:14:50:450.439 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: Applying named configuration failed 2025-02-13 Thu 02:14:50:450.878 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.20.0.6:8093 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-02-13 Thu 02:14:50:450.969 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been started controller/src/dns/main.cc 384 2025-02-13 Thu 02:14:50:451.076 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 303 2025-02-13 Thu 02:14:50:451.291 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-02-13 Thu 02:14:50:451.347 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-02-13 Thu 02:14:50:451.520 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:14:50:451.554 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: SANDESH: Send FAILED: 1739412890451227 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-02-13 Thu 02:14:50:451.564 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:14:50:539.431 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:14:50:539.497 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: SANDESH: Send FAILED: 1739412890538889 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-02-13 Thu 02:14:50:539.509 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:14:50:539.532 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-02-13 Thu 02:14:50:539.553 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 307 2025-02-13 Thu 02:14:50:540.292 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:14:50:540.317 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: SANDESH: Send FAILED: 1739412890539582 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down ], ] ] ] 2025-02-13 Thu 02:14:50:540.325 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:14:50:540.358 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 580 2025-02-13 Thu 02:14:50:540.367 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-02-13 Thu 02:14:50:610.427 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 95 2025-02-13 Thu 02:14:50:614.236 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 104 2025-02-13 Thu 02:14:50:614.286 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 110 2025-02-13 Thu 02:14:50:615.065 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:14:50:615.106 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: SANDESH: Send FAILED: 1739412890614324 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:14:50:615.127 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:14:50:615.154 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:615.170 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 393 2025-02-13 Thu 02:14:50:622.837 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:625.926 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:631.419 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:633.550 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:636.513 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:639.530 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:642.803 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:646.381 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:655.918 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:658.068 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:660.199 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:662.571 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:664.215 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:665.347 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:669.207 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:670.347 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:673.545 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:677.120 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:679.493 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:681.304 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:682.173 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:683.060 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:684.036 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:686.229 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:687.776 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:689.968 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:691.718 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:693.035 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:704.008 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:708.150 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:709.919 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:711.158 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:713.047 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:714.802 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:716.746 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:720.314 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:723.468 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:724.771 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:726.960 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:727.991 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:728.951 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:733.341 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:734.655 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:744.817 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:749.981 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:752.648 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:755.837 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:758.397 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:759.308 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:760.300 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:761.349 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:762.311 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:764.343 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:767.136 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:768.020 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:768.927 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:769.783 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:770.716 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:771.564 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:772.985 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:774.289 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:775.151 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:776.843 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:779.409 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:780.935 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:781.803 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:785.120 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:786.120 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:787.819 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:792.804 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:797.059 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:798.325 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:800.420 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:810.388 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:813.009 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:816.641 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:817.871 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:819.677 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:820.822 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:822.401 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:826.357 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:836.079 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:837.344 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:851.644 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:856.716 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:878.566 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:886.752 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:894.587 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:896.936 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:902.722 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:905.685 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:908.656 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:911.302 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:922.135 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:924.764 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:926.008 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:929.352 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:933.180 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:943.815 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:947.563 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:949.339 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:952.380 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:974.667 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:980.500 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:988.554 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:993.115 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:50:995.019 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:004.707 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:006.356 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:007.624 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:009.045 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:015.455 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:017.426 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:042.518 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:109.572 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:121.201 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:154.493 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:168.529 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:177.309 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-13 Thu 02:14:51:179.122 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-13 Thu 02:14:51:180.136 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-13 Thu 02:14:51:180.310 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-13 Thu 02:14:51:180.483 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-13 Thu 02:14:51:180.610 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-13 Thu 02:14:51:180.727 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-02-13 Thu 02:14:51:180.876 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 554 2025-02-13 Thu 02:14:51:180.905 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 197 2025-02-13 Thu 02:14:51:180.922 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 225 2025-02-13 Thu 02:14:51:181.838 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:14:51:181.878 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: SANDESH: Send FAILED: 1739412891180991 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:14:51:181.887 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:14:51:198.610 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:200.233 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router e15f6341-aa9c-45db-90d6-02c0957ad54b controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:200.273 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router e15f6341-aa9c-45db-90d6-02c0957ad54b controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:200.583 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance f4323971-2145-40b5-b445-ba9938e47ae9 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:200.792 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:200.828 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:200.844 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:200.859 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:200.872 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:200.890 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:200.905 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:overlay-bgp controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:200.928 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:200.944 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:underlay-ip-clos controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:200.955 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:200.969 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:telemetry controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:200.979 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:200.992 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:infra-bms-access controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.003 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.017 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:route-reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.027 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.041 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.055 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.070 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.088 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.103 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-72q controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.116 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.129 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-36q controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.140 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.152 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-60c controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.162 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.174 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.185 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.197 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.208 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.222 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vqfx-10000 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.233 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.246 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.257 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.272 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-6 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.305 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.317 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.343 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating netconf-profile:default-domain:default-project:netconf-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.354 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.366 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.382 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.394 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.422 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.435 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.456 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.468 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.499 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.512 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_device_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.573 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.610 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-4 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.629 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.643 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating grpc-profile:default-domain:default-project:grpc-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.663 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.680 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.695 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.711 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.736 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.751 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.767 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:lean controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.781 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.795 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.806 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.820 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-128c controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.847 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.864 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.884 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:_internal_ipam_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.906 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.918 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.932 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.946 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:pnf-service-chaining controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.957 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.970 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:pnf-servicechain controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:201.981 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:201.999 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.013 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:erb-leaf:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.027 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:erb-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.038 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.050 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-pnf-servicechain-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.064 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.075 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.090 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.109 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.121 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.133 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.148 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.162 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating snmp-profile:default-domain:default-project:snmp-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.183 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.205 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Storage-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.224 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.238 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.249 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.262 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2728-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.278 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.293 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.308 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.320 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.342 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:port-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.360 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.373 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4100 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.384 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:202.939 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.972 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:202.989 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:203.003 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:203.014 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:203.029 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-client controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:203.040 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:203.056 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:203.068 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:203.087 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:206.048 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:206.860 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 3543699f-6c08-4704-98af-939e6cf6588d controller/src/ifmap/client/config_json_parser.cc 217 2025-02-13 Thu 02:14:51:207.666 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 9cab8422-f1b8-4728-8112-6e08df385fda controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:209.052 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:209.842 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 8ff42ec6-8018-47c9-8553-20a9db9b63ce controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:209.859 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 8ff42ec6-8018-47c9-8553-20a9db9b63ce controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:209.913 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 96a20137-3d1c-4e85-bb98-aa1d65f737d3 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:210.862 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:212.717 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:213.171 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 6eb280d2-bd97-4a46-ad43-22bb2bf76fb1 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:214.204 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:215.045 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 97f20a83-9210-4945-a6fd-a0d292bec38c controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:215.063 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 97f20a83-9210-4945-a6fd-a0d292bec38c controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:215.643 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.675 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.694 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.711 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.735 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.752 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.772 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.800 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:215.829 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.845 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:215.866 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.886 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:erb-ucast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:215.910 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.925 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:_internal_vn_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:215.956 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:215.981 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:default-project:_internal_ipam_ipv6_link_local,default-domain:default-project:_internal_vn_ipv6_link_local) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:215.993 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:216.012 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:216.029 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5220:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:216.050 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5220 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:216.066 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:216.078 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:216.260 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:217.084 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 51b1525d-27c0-4807-9edd-8ca67dc4da0d controller/src/ifmap/client/config_json_parser.cc 217 2025-02-13 Thu 02:14:51:217.105 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 51b1525d-27c0-4807-9edd-8ca67dc4da0d controller/src/ifmap/client/config_json_parser.cc 217 2025-02-13 Thu 02:14:51:226.606 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:226.656 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.676 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:226.695 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-management-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.719 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:226.733 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.748 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.760 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:226.774 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4600 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.789 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.808 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.826 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.839 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:226.852 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.872 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:226.886 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.911 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:226.925 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-mx controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.947 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:226.965 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx240 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:226.977 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:226.992 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.003 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.016 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.027 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.043 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2010 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.060 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.074 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2020 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.084 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.097 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.108 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.122 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx204 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.133 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.146 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.156 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.170 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2008 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.181 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.196 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx10003 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.207 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.219 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vmx controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.230 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.242 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx960 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.253 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.272 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx480 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.282 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.298 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.317 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_mac_mob_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.356 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.371 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:vcenter_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.392 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.412 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.430 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.447 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.461 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:test_overlay_connectivity_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.482 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.497 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.513 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.527 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.542 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.560 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5120 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.579 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.593 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48y-8c controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.604 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.618 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-32c controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.665 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.682 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48t-6c controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.692 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.708 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.721 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.737 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.750 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.761 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.776 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.790 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.811 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.826 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.839 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.854 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.872 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.889 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.904 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.919 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.932 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:vn-interconnect controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.942 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.955 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:227.965 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.979 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:227.993 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l2-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.003 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.017 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dci-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.028 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.046 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.065 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.078 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-spine:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.095 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.132 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.146 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.158 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hardware_inventory_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.180 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.195 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.213 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.226 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.242 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.255 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_role_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.273 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.288 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.302 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.320 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.344 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.360 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.373 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5210-64c controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.390 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.403 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.423 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.439 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.454 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-5 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.470 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.488 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.502 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.520 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.534 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.556 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.570 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.588 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.606 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.621 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.634 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_os_computes_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.654 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.670 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.684 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.701 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.716 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.733 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.748 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.763 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.780 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.794 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:existing_fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.814 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.830 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.847 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.863 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.878 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.893 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.909 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.924 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.937 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.953 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-overlay-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.970 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:228.983 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:228.998 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.016 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.026 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.039 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.052 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.064 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.082 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.095 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:image_upgrade_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.119 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.132 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.150 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.165 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.175 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Leaf-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.192 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.208 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.223 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.239 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.254 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-srx controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.273 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.287 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx1500 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.298 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.356 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.380 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5800 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.392 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.406 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5400 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.416 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.429 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx240h-poe controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.439 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.454 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4200 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.464 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.476 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5600 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.486 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.506 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vsrx controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.516 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.531 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.546 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.563 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.582 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.601 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.616 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.643 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.659 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.675 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.693 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.709 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.724 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.738 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.757 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.773 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.788 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.805 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.817 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.833 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.854 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.879 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.899 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-32c-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.913 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.927 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.946 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.959 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:229.978 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:229.995 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:230.012 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.030 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:230.052 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.065 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:230.082 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.104 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:230.120 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.136 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.152 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.173 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.187 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:firewall controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:230.197 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.213 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.231 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.247 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.261 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.278 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-mcast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:230.289 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.304 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.317 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:230.346 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.360 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:230.377 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:230.389 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:231.248 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:14:51:243.744 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance e9856921-35c3-4230-92ca-86fd0c37e8e7 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:14:51:243.997 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.022 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-access-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.051 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.085 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.103 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hitless_upgrade_strategy_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.132 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.152 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.177 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.211 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.246 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.266 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.282 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:check_multicast_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.307 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.338 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.368 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.384 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.408 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.424 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.441 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.465 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.483 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.502 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.518 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.537 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.553 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.568 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.583 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.602 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.617 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.629 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.646 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.669 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:topology_discovery_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.689 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.703 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.723 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.739 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.755 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.772 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.790 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.805 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.819 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.834 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.853 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.868 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.883 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.913 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.929 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:244.950 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.978 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:244.995 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:252.565 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.626 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-access controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:252.649 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.685 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.705 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2728-2:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:252.726 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2728-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:252.741 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.763 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.790 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:252.807 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.827 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.852 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.875 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.901 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.917 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.932 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.946 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.962 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.981 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:252.999 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.017 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.033 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.055 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.071 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:rma_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.096 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.111 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-mx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.129 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.146 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.173 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.200 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.218 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.237 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.252 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L2-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.270 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.286 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.300 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.322 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.347 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.364 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.380 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-all-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.391 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.405 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-32cd controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.416 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.434 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.446 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.462 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.477 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:253.494 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:server_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:253.515 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.288 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:254.312 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.344 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.371 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-fabric-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:254.396 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.440 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:254.495 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.521 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.544 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.566 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.603 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:container_cleanup_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:254.666 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.697 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-48y controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:254.711 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:254.729 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.748 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.772 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.792 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.810 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.827 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.844 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-srx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:254.864 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.883 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:254.904 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:254.923 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.683 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.711 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:255.730 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:255.758 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.779 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:255.797 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.823 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.842 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.864 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.880 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.898 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.915 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.932 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.952 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.969 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:255.991 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.007 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-peer-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.031 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.046 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:cli_sync_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.076 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.091 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-leaf:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.108 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.135 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.159 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.176 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.193 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.219 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.237 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.251 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-ebgp-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.271 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.291 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.313 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.346 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.362 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:search_ip_mac_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.389 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.409 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.435 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.455 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.477 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.495 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:node_profile_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.514 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.527 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.541 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.553 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_chassis_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.577 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.593 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5120:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.612 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.635 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.649 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_interface_details_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.674 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.696 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.734 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.759 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.774 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-48s-4c controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.793 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.814 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.833 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.850 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.866 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.884 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.901 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.920 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.944 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.963 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:256.976 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:256.995 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.011 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.029 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.044 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.059 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-aa controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.077 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.091 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.111 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.125 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.140 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.159 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.177 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.194 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.208 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.227 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.243 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.261 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.276 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_server_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.296 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.321 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.348 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.367 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.383 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.398 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.413 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.430 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.445 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.464 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.478 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.499 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.514 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.530 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.550 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2728-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.571 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.587 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.612 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.630 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.644 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.661 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.678 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-3 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.695 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.714 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.730 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.749 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.766 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.787 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.805 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_ops_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.826 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.843 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.860 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:257.877 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.900 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.923 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.939 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.955 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.970 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:257.987 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.005 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.019 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.034 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.052 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.067 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.083 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.102 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:ztp_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.123 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.137 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.152 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.172 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.194 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.213 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.229 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.248 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.263 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.278 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Spine-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.301 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.318 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.343 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.364 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.381 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.396 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.426 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.445 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.461 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.476 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.494 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.512 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.530 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.546 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.561 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.590 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.607 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.621 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.640 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Gateway-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.657 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.674 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.691 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:role_assignment_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.715 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.730 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.771 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.788 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_deactivate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.814 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.831 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2728-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.856 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.877 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.893 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.908 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.931 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.949 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:258.968 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:258.997 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.026 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.042 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.060 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.133 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.152 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.169 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.194 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.215 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.230 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.246 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.263 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.278 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.293 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.307 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.338 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.353 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.368 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.383 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.400 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.415 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.430 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.445 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.464 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.482 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.498 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.518 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.536 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.551 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.566 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.587 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.602 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.616 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.630 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.649 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.665 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.679 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.699 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.714 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.736 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.759 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:device-functional-group controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.776 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.791 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.810 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.833 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.847 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.864 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.881 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.899 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.912 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Lean-Spine-with-Route-Reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.932 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.949 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:259.963 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:259.978 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.000 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.015 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:260.035 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.058 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.072 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:260.090 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.113 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.133 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.149 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.164 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.178 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.197 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.211 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.231 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.250 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.264 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:260.281 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.295 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:260.316 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:260.344 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-properties:default-global-system-config:config_property controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:14:51:260.363 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-properties controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:14:51:261.690 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: EndOfRib point was reached, IF-MAP objects have been created controller/src/dns/main.cc 86 2025-02-13 Thu 02:14:51:261.717 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS.0, counting 0 elements controller/src/dns/main.cc 98 2025-02-13 Thu 02:14:51:261.728 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS_record.0, counting 0 elements controller/src/dns/main.cc 98 2025-02-13 Thu 02:14:51:261.737 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.network_ipam.0, counting 3 elements controller/src/dns/main.cc 98 2025-02-13 Thu 02:14:51:261.746 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_network_network_ipam.0, counting 1 elements controller/src/dns/main.cc 98 2025-02-13 Thu 02:14:51:261.755 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.global_qos_config.0, counting 1 elements controller/src/dns/main.cc 98 2025-02-13 Thu 02:14:51:261.772 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: VnniConfig has been updated after the bulk sync, the number of elements: 1 controller/src/dns/main.cc 109 2025-02-13 Thu 02:14:51:261.780 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: IpamConfig has been updated after the bulk sync, the number of elements: 3 controller/src/dns/main.cc 120 2025-02-13 Thu 02:14:51:261.789 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 131 2025-02-13 Thu 02:14:51:261.797 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsRecordConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 142 2025-02-13 Thu 02:14:51:261.805 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: GlobalQosConfig has been updated after the bulk sync controller/src/dns/main.cc 152 2025-02-13 Thu 02:14:51:261.860 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-02-13 Thu 02:14:51:261.875 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-02-13 Thu 02:14:51:262.028 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:14:51:262.064 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: SANDESH: Send FAILED: 1739412891261837 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-02-13 Thu 02:14:51:262.074 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:14:51:367.459 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-02-13 Thu 02:14:51:369.768 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.35:37756::10.0.0.46:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-02-13 Thu 02:14:51:369.814 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: 10.0.0.35:37756::10.0.0.46:8086(-1) OnSessionEvent TCP Connected 2025-02-13 Thu 02:14:51:369.826 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: 10.0.0.35:37756::10.0.0.46:8086(-1):EvTcpConnected 2025-02-13 Thu 02:14:51:369.892 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: Processing scm::EvSandeshSend in state Connect 2025-02-13 Thu 02:14:51:369.924 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: SANDESH: Send FAILED: 1739412891367414 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:14:51:369.934 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-02-13 Thu 02:14:51:369.944 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: Processing scm::EvTcpConnected in state Connect 2025-02-13 Thu 02:14:51:369.951 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: Connect : EvTcpConnected : Cancelling Connect timer 2025-02-13 Thu 02:14:51:369.999 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ClientInit 2025-02-13 Thu 02:14:51:370.019 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2728-2:contrail-dns:0:Control count 1 2025-02-13 Thu 02:14:51:370.155 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:14:51:370.169 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-02-13 Thu 02:14:51:370.192 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: SANDESH: Send FAILED: 1739412891369984 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-02-13 Thu 02:14:51:370.200 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: Received UVE message in wrong state : NodeStatusUVE 2025-02-13 Thu 02:14:51:370.208 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:14:51:370.215 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-02-13 Thu 02:14:51:370.252 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: Processing scm::EvSandeshSend in state ClientInit 2025-02-13 Thu 02:14:51:370.260 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-02-13 Thu 02:14:51:370.453 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: SANDESH: Send FAILED: 1739412891370137 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 113620 http_port = 8092 start_time = 1739412890384188 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 920, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-02-13 Thu 02:14:51:370.475 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-02-13 Thu 02:14:51:370.559 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 225 2025-02-13 Thu 02:14:51:370.689 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named up; DNS is operational controller/src/dns/mgr/dns_mgr.cc 737 2025-02-13 Thu 02:14:51:373.478 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: OnMessage control in state: ClientInit 2025-02-13 Thu 02:14:51:373.527 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-02-13 Thu 02:14:51:373.537 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ClientInit : EvSandeshMessageRecv 2025-02-13 Thu 02:14:51:373.562 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: Received Ctrl Message with size 0 2025-02-13 Thu 02:14:51:373.573 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 0 2025-02-13 Thu 02:14:51:373.746 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2728-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 113620 http_port = 8092 start_time = 1739412890384188 collector_name = collector_ip = 10.0.0.46:8086 collector_list= [ [ (*_iter40) = 10.0.0.46:8086, (*_iter40) = 10.0.0.12:8086, (*_iter40) = 10.0.0.35:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 920, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] proxy seq 5 2025-02-13 Thu 02:14:51:373.781 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-02-13 Thu 02:14:51:373.806 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2728-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.46:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.46:9041, (*_iter6) = 10.0.0.35:9041, (*_iter6) = 10.0.0.12:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.46:5673, (*_iter6) = 10.0.0.35:5673, (*_iter6) = 10.0.0.12:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 8 2025-02-13 Thu 02:14:51:373.817 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-02-13 Thu 02:14:51:373.830 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-02-13 Thu 02:14:51:373.837 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-02-13 Thu 02:14:51:373.845 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-02-13 Thu 02:14:51:373.880 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: Established 2025-02-13 Thu 02:14:52:421.415 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: Applying named configuration failed 2025-02-13 Thu 02:14:52:421.522 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been done (the DB has been synced with named) controller/src/dns/mgr/dns_mgr.cc 455 2025-02-13 Thu 02:14:52:983.771 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:15:12:753.520 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.29 SEND Xmpp creating dynamic channel 10.20.0.6:8093::10.20.0.29:34699 controller/src/xmpp/xmpp_server.cc 586 2025-02-13 Thu 02:15:12:753.634 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.29 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2728-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-02-13 Thu 02:15:12:753.684 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8093::10.20.0.29:34699 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:15:12:753.827 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.29 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.29 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-02-13 Thu 02:15:12:754.580 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.29 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:15:12:754.748 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.29 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 34699 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:15:12:757.799 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.7 SEND Xmpp creating dynamic channel 10.20.0.6:8093::10.20.0.7:42219 controller/src/xmpp/xmpp_server.cc 586 2025-02-13 Thu 02:15:12:757.859 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.7 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2728-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-02-13 Thu 02:15:12:757.903 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8093::10.20.0.7:42219 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:15:12:757.985 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.7 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.7 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-02-13 Thu 02:15:12:758.158 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:15:12:758.253 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 42219 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:15:12:759.564 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.29 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2728-2/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:15:12:761.533 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2728-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:15:36:147.110 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:16:03:921.434 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.46:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-02-13 Thu 02:16:03:921.560 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-02-13 Thu 02:16:03:921.575 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-02-13 Thu 02:16:03:928.663 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.46:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-02-13 Thu 02:16:04:395.872 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-02-13 Thu 02:17:32:967.949 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:36928 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:17:33:479.886 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:38862 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:17:34:002.445 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:49448 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:17:43:402.330 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.35:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-02-13 Thu 02:17:43:415.369 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-02-13 Thu 02:17:43:415.413 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-02-13 Thu 02:17:43:415.567 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.35:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-02-13 Thu 02:17:43:662.233 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-02-13 Thu 02:17:58:455.305 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:52762 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:17:59:903.883 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:35196 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:18:00:020.368 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:52544 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:19:22:309.747 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.12:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-02-13 Thu 02:19:22:331.630 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-02-13 Thu 02:19:22:331.680 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-02-13 Thu 02:19:22:349.883 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.12:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-02-13 Thu 02:19:22:766.746 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402321495808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-02-13 Thu 02:22:32:974.842 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:40734 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:22:33:483.226 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:54014 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:22:34:006.055 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:41530 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:22:58:454.722 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:40010 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:22:59:910.233 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:53044 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:23:00:020.433 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:55566 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:27:32:986.592 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:60470 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:27:33:487.945 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:52428 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:27:34:009.883 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:57790 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:27:58:456.406 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:58176 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:27:59:912.307 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:42624 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:28:00:031.573 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:43238 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:32:31:281.895 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.29 RECV Mode Server: Event: Tcp Connection Closed peer ip: 10.20.0.29 ( an-jenkins-deploy-platform-ansible-os-2728-2/dns ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-02-13 Thu 02:32:31:282.677 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.29 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2728-2 To : an-jenkins-deploy-platform-ansible-os-2728-2/dns controller/src/xmpp/xmpp_connection.cc 734 2025-02-13 Thu 02:32:31:282.746 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.29 state = Established next_state = Idle event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:32:31:282.824 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.29 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:32:31:290.759 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.7 RECV Mode Server: Event: Tcp Connection Closed peer ip: 10.20.0.7 ( an-jenkins-deploy-platform-ansible-os-2728-1/dns ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-02-13 Thu 02:32:31:290.943 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Established next_state = Idle event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:32:31:290.970 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.7 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2728-2 To : an-jenkins-deploy-platform-ansible-os-2728-1/dns controller/src/xmpp/xmpp_connection.cc 734 2025-02-13 Thu 02:32:31:291.019 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:32:32:982.422 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:55170 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:32:33:488.411 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:44428 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:32:34:010.238 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:54744 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:32:58:461.291 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:45410 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:32:59:913.137 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:40316 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:33:00:028.575 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:50508 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:34:22:488.851 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.29 SEND Xmpp creating dynamic channel 10.20.0.6:8093::10.20.0.29:37693 controller/src/xmpp/xmpp_server.cc 586 2025-02-13 Thu 02:34:22:488.929 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.29 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2728-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-02-13 Thu 02:34:22:488.980 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8093::10.20.0.29:37693 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:34:22:489.063 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.29 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.29 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-02-13 Thu 02:34:22:489.157 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.29 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:34:22:494.374 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.29 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 37693 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:34:22:494.495 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.29 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2728-2/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:34:24:525.114 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.7 SEND Xmpp creating dynamic channel 10.20.0.6:8093::10.20.0.7:35501 controller/src/xmpp/xmpp_server.cc 586 2025-02-13 Thu 02:34:24:525.194 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.7 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2728-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-02-13 Thu 02:34:24:525.236 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8093::10.20.0.7:35501 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:34:24:525.339 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:34:24:525.339 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2728-2:10.20.0.7 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.7 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-02-13 Thu 02:34:24:525.548 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 35501 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:34:24:750.076 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.7 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2728-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-02-13 Thu 02:34:25:198.570 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:34:25:425.155 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:34:26:019.187 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:34:26:259.415 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:22:215.656 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:22:215.831 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:admin controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:22:215.866 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:22:286.035 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:22:286.240 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:admin:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:22:286.306 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:22:379.186 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:22:379.405 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:22:528.450 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:22:528.717 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:admin:default controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:22:528.773 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:22:655.315 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:22:752.679 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:22:752.882 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:22:752.925 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:22:883.167 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:22:883.369 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:22:883.410 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:23:966.521 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.35:8092::10.0.0.46:37152 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:36:25:575.177 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:25:575.340 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-AnalyticsBasicTestSanity-15013551 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:25:575.379 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:25:653.385 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:25:653.556 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:25:653.598 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:25:717.897 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:25:718.115 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:25:894.566 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:25:894.802 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:25:894.844 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:26:010.354 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:26:010.592 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:26:010.654 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:26:087.710 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:26:173.401 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:26:173.587 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:26:173.625 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:28:961.663 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:29:457.430 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:29:568.334 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:29:568.563 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-15013551:ctest-vn22-67883455 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:29:568.612 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:29:649.722 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:29:751.177 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:29:812.414 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:29:812.539 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 7adcf5d4-7e9a-4411-90c6-9407383b179e controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:36:29:964.915 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:29:965.105 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-15013551:ctest-vn22-67883455,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:29:965.131 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:29:965.154 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:30:036.395 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:30:782.369 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:31:132.381 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:35:148.929 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:37:433.090 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:37:487.995 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:37:488.184 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:1664be32-9074-4b6e-9354-a3b867117b57 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:37:605.876 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:37:606.095 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-15013551:d69989a6-d4a8-4f4f-b128-46399aa37f4b controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:37:606.136 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:37:606.162 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:37:606.187 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:37:606.205 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:37:703.976 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:37:851.233 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:37:851.570 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:2cf56a8f-2842-49e6-977d-83602d1310ed controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:37:851.614 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:37:851.640 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:38:567.990 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:38:645.754 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:52:591.883 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:36:52:591.941 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:36:52:591.953 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:2cf56a8f-2842-49e6-977d-83602d1310ed controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:36:52:591.977 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:2cf56a8f-2842-49e6-977d-83602d1310ed - virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-15013551:d69989a6-d4a8-4f4f-b128-46399aa37f4b , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:36:52:591.999 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:2cf56a8f-2842-49e6-977d-83602d1310ed - virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-15013551:ctest-vn22-67883455 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:36:52:662.889 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:52:740.890 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:36:52:740.957 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:36:52:740.985 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:36:52:741.012 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:36:52:741.027 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-15013551:d69989a6-d4a8-4f4f-b128-46399aa37f4b controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:36:52:741.064 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-15013551:d69989a6-d4a8-4f4f-b128-46399aa37f4b - project:default-domain:ctest-AnalyticsBasicTestSanity-15013551 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:36:52:741.088 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-15013551:d69989a6-d4a8-4f4f-b128-46399aa37f4b - security-group:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:36:52:741.104 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-15013551:d69989a6-d4a8-4f4f-b128-46399aa37f4b - virtual-machine:1664be32-9074-4b6e-9354-a3b867117b57 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:36:52:741.118 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-15013551:d69989a6-d4a8-4f4f-b128-46399aa37f4b - virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-15013551:ctest-vn22-67883455 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:36:52:798.182 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:1664be32-9074-4b6e-9354-a3b867117b57 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:36:54:035.901 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:36:54:035.977 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:36:54:036.079 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:36:54:036.097 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-15013551:ctest-vn22-67883455 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:36:54:036.113 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-15013551:ctest-vn22-67883455,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:36:54:036.155 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-15013551:ctest-vn22-67883455 - project:default-domain:ctest-AnalyticsBasicTestSanity-15013551 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:36:54:036.181 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-15013551:ctest-vn22-67883455 - virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-15013551:ctest-vn22-67883455,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:36:54:036.201 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-15013551:ctest-vn22-67883455,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:36:54:134.446 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 7adcf5d4-7e9a-4411-90c6-9407383b179e controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:36:54:344.773 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:55:154.368 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:55:236.049 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:55:334.963 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:55:470.606 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:56:562.566 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:56:562.719 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-FloatingipBasicTestSanity-60426687 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:56:562.756 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:56:613.875 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:56:614.076 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-FloatingipBasicTestSanity-60426687:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:56:614.139 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:56:662.339 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:56:662.542 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:56:777.842 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:56:778.087 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-FloatingipBasicTestSanity-60426687:default controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:56:778.130 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:56:860.603 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:56:860.794 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-FloatingipBasicTestSanity-60426687:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:56:860.834 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:56:931.444 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:56:945.988 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:56:946.188 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-FloatingipBasicTestSanity-60426687:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:36:56:946.231 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:36:58:603.446 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:59:498.196 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:59:688.472 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:59:744.340 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:36:59:771.167 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:00:885.040 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:01:081.588 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:01:156.876 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:01:157.057 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:01:157.104 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:01:239.736 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:01:297.273 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:01:341.238 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:01:341.398 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 005b15c3-82a4-48b0-b9f5-9a5476f7399c controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:37:01:514.363 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:01:514.569 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:01:514.669 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:01:514.691 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:01:574.093 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:02:235.775 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:02:576.535 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:04:064.806 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:04:221.682 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:04:312.556 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:04:312.742 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-vn1-92496004 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:04:312.805 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:04:426.645 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:04:478.347 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:04:517.978 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:04:518.098 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance dd3a7524-314f-47d6-a9ec-71035e1ecdbb controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:37:04:647.002 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:04:647.208 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-vn1-92496004,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:04:647.233 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:04:647.262 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:04:725.015 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:05:045.464 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:05:426.480 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:06:739.566 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:07:505.239 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:07:563.896 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:07:564.039 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:53487c52-10b4-434d-80c2-7a9c20c2408c controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:07:639.102 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:07:640.381 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:adc3cdbb-e014-41d9-b4c0-c3926d748821 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:07:640.510 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:07:640.567 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:07:640.590 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:07:640.622 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:07:695.877 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:07:847.786 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:07:848.038 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:965e3133-5831-4994-b448-d5b9c47a5569 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:07:848.094 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:07:848.131 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:08:097.962 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:08:159.175 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:08:233.014 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:08:757.523 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:08:934.157 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:08:934.335 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998:ctest-some-pool-92860323 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:08:934.405 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:09:007.971 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:09:008.200 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:09:190.714 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:09:391.388 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:09:668.061 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:09:751.469 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:09:751.697 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:2ed211c4-5405-4ada-af2c-d1281321ddb5 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:09:855.879 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:09:857.708 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:660fde91-b8b8-4bce-b36e-d1dd025f8729 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:09:857.761 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:09:857.791 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:09:857.814 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:09:857.833 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:09:917.090 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:10:056.657 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:10:056.851 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:aed936cc-45ce-460a-8485-505445fe4e10 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:10:056.897 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:10:056.932 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:10:784.008 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:10:849.946 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:19:967.967 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:20:092.654 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:20:093.076 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998:ctest-some-pool-92860323:6bbb2d9a-f3ff-4f32-9a23-070162f48e7c controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:20:093.137 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-pool-floating-ip controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:20:093.180 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-project controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:20:246.519 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:20:246.739 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:29:386.754 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:29:386.973 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:29:387.008 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998:ctest-some-pool-92860323:6bbb2d9a-f3ff-4f32-9a23-070162f48e7c - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:adc3cdbb-e014-41d9-b4c0-c3926d748821 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:29:491.591 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:29:491.645 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:29:491.658 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting floating-ip:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998:ctest-some-pool-92860323:6bbb2d9a-f3ff-4f32-9a23-070162f48e7c controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:29:491.681 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998:ctest-some-pool-92860323:6bbb2d9a-f3ff-4f32-9a23-070162f48e7c - floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998:ctest-some-pool-92860323 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:29:491.703 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998:ctest-some-pool-92860323:6bbb2d9a-f3ff-4f32-9a23-070162f48e7c - project:default-domain:ctest-FloatingipBasicTestSanity-60426687 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:29:568.864 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:29:569.047 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:29:569.079 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-FloatingipBasicTestSanity-60426687 - floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998:ctest-some-pool-92860323 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:29:640.744 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:29:640.791 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998:ctest-some-pool-92860323 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:29:640.816 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998:ctest-some-pool-92860323 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:392.759 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:392.823 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:392.838 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:aed936cc-45ce-460a-8485-505445fe4e10 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:30:392.861 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:aed936cc-45ce-460a-8485-505445fe4e10 - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:660fde91-b8b8-4bce-b36e-d1dd025f8729 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:392.886 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:aed936cc-45ce-460a-8485-505445fe4e10 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:455.954 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:30:511.615 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:511.664 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:511.688 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:965e3133-5831-4994-b448-d5b9c47a5569 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:30:511.713 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:965e3133-5831-4994-b448-d5b9c47a5569 - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:adc3cdbb-e014-41d9-b4c0-c3926d748821 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:511.733 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:965e3133-5831-4994-b448-d5b9c47a5569 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-vn1-92496004 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:529.779 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:529.839 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:529.860 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:529.879 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:529.891 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:660fde91-b8b8-4bce-b36e-d1dd025f8729 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:30:529.913 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:660fde91-b8b8-4bce-b36e-d1dd025f8729 - project:default-domain:ctest-FloatingipBasicTestSanity-60426687 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:529.935 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:660fde91-b8b8-4bce-b36e-d1dd025f8729 - security-group:default-domain:ctest-FloatingipBasicTestSanity-60426687:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:529.951 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:660fde91-b8b8-4bce-b36e-d1dd025f8729 - virtual-machine:2ed211c4-5405-4ada-af2c-d1281321ddb5 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:529.975 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:660fde91-b8b8-4bce-b36e-d1dd025f8729 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:592.815 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:2ed211c4-5405-4ada-af2c-d1281321ddb5 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:30:629.860 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:30:689.265 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:689.322 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:689.343 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:689.364 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:30:689.376 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:adc3cdbb-e014-41d9-b4c0-c3926d748821 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:30:689.398 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:adc3cdbb-e014-41d9-b4c0-c3926d748821 - project:default-domain:ctest-FloatingipBasicTestSanity-60426687 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:689.419 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:adc3cdbb-e014-41d9-b4c0-c3926d748821 - security-group:default-domain:ctest-FloatingipBasicTestSanity-60426687:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:689.448 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:adc3cdbb-e014-41d9-b4c0-c3926d748821 - virtual-machine:53487c52-10b4-434d-80c2-7a9c20c2408c , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:689.464 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-60426687:adc3cdbb-e014-41d9-b4c0-c3926d748821 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-vn1-92496004 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:30:738.319 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:53487c52-10b4-434d-80c2-7a9c20c2408c controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:31:984.700 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:31:984.761 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:31:984.778 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:31:984.789 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-vn1-92496004 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:31:984.800 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-vn1-92496004,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:31:984.824 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-vn1-92496004 - project:default-domain:ctest-FloatingipBasicTestSanity-60426687 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:31:984.845 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-vn1-92496004 - virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-vn1-92496004,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:31:984.861 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-vn1-92496004,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:32:061.863 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance dd3a7524-314f-47d6-a9ec-71035e1ecdbb controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:37:32:258.264 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:32:435.688 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:32:435.747 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:32:435.763 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:32:435.775 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:32:435.786 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:32:435.809 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998 - project:default-domain:ctest-FloatingipBasicTestSanity-60426687 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:32:435.831 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998 - virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:32:435.847 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-60426687:ctest-fvn-62977998,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:32:521.639 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 005b15c3-82a4-48b0-b9f5-9a5476f7399c controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:37:32:701.207 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:32:994.044 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:44680 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:37:33:503.311 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:33:510.934 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:36812 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:37:33:571.783 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:33:625.899 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:33:688.366 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:33:771.738 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:33:771.819 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove security-group:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default - project:default-domain:ctest-AnalyticsBasicTestSanity-15013551 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:33:878.727 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:33:879.056 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:33:879.095 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:33:879.148 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default:ingress-access-control-list - security-group:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:33:944.251 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:33:967.804 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:33:967.855 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:33:967.869 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting security-group:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:33:967.893 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default:egress-access-control-list - security-group:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:34:017.718 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:35074 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:37:34:033.839 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:34:034.071 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:34:034.126 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-AnalyticsBasicTestSanity-15013551 - application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default-application-policy-set , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:34:102.869 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:34:102.914 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:34:102.950 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-15013551:default-application-policy-set - project:default-domain:ctest-AnalyticsBasicTestSanity-15013551 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:34:129.073 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:34:164.354 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:34:177.163 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:37:34:177.259 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting project:default-domain:ctest-AnalyticsBasicTestSanity-15013551 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:37:34:177.284 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-AnalyticsBasicTestSanity-15013551 - domain:default-domain , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:37:34:251.840 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:34:370.107 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:34:472.770 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:35:568.705 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:35:568.881 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-TestHeat-40422476 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:35:568.920 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:35:635.317 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:35:635.518 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-TestHeat-40422476:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:35:635.593 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:35:695.181 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:35:695.361 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:35:869.767 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:35:870.002 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-TestHeat-40422476:default controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:35:870.060 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:35:970.287 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:35:970.481 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestHeat-40422476:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:35:970.523 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:36:038.359 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:36:065.034 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:36:065.220 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestHeat-40422476:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:36:065.271 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:40:635.918 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:40:696.581 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:40:819.659 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:40:929.323 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:42:049.923 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:42:050.089 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-TestRoutersBasic-74813182 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:42:050.128 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:42:105.160 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:42:105.337 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-TestRoutersBasic-74813182:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:42:105.389 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:42:157.664 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:42:157.832 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:42:272.480 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:42:272.768 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-TestRoutersBasic-74813182:default controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:42:272.813 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:42:343.567 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:42:343.759 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestRoutersBasic-74813182:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:42:343.809 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:42:447.692 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:42:456.940 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:42:457.265 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestRoutersBasic-74813182:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:42:457.331 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:46:235.286 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:46:423.348 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:46:643.335 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:46:705.673 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:46:744.004 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:46:826.532 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:028.729 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:100.599 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:100.787 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-vn-47525958 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:47:100.837 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:47:165.471 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:246.722 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:284.740 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:284.860 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0079e53f-93b7-4394-8e4c-bc72f1da06b3 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:37:47:382.438 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:382.632 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-74813182:ctest-vn-47525958,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:47:382.660 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:47:382.681 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:47:434.698 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:667.809 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:821.535 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:884.837 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:47:885.046 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:47:885.103 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:47:975.168 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:48:025.800 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:48:044.939 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:48:045.092 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip-pool:default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226:floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:48:045.131 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:48:096.923 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:48:097.044 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance fe84b77a-d54b-4d14-b528-c4318f50bced controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:37:48:242.656 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:48:242.947 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:48:242.990 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:48:243.066 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:48:321.412 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:49:483.494 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:50:184.394 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:50:234.657 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:50:234.806 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:35070365-bf60-41fa-a049-d7c7a3d4ca51 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:50:311.140 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:50:311.349 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:53c0efe6-9670-4abd-a70e-8538004e8a73 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:50:311.393 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:50:311.422 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:50:311.444 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:50:311.464 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:50:390.514 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:50:509.272 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:50:509.425 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:37756c08-31e6-4d43-ad39-1c558523d3e1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:50:509.470 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:50:509.493 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:50:717.620 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:50:773.735 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:50:884.974 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:317.987 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:394.655 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:394.837 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating logical-router:default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:51:394.887 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-logical-router controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:51:456.327 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:517.704 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:517.880 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating logical-router-virtual-network:attr(default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226,default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:51:517.905 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:51:517.927 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:51:532.337 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:711.130 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:783.779 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:835.231 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:835.431 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:51:835.476 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:51:835.505 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:51:835.525 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:51:835.546 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:51:852.684 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:852.870 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:52e5387e-0103-4627-bb92-3be0d24d6954 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:51:876.030 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:51:876.231 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:08286d29-7318-43a2-87c3-ce549b0ce019 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:51:876.289 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:51:876.318 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:51:984.100 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:044.003 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:092.349 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:120.044 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:120.353 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:021ec554-0065-45a9-888c-3cc727f88830 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:52:120.416 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:120.453 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:120.476 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:120.497 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:167.737 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:167.849 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance a05bc034-37ef-403f-b35d-6ffe52500571 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:37:52:171.857 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:172.041 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-instance:default-domain:ctest-TestRoutersBasic-74813182:snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:52:172.094 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:172.133 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating service-instance-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:208.050 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:208.400 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:c3c4f0c1-ff60-45b7-96c3-dfc2d9edf72b controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:52:208.468 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:208.503 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:214.861 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:303.966 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:304.170 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-table:default-domain:ctest-TestRoutersBasic-74813182:rt_986baa77-1cc5-48fb-881b-f2164f3bec0c controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:52:304.223 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-route-table controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:331.423 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:368.352 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:368.588 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:d203fcd4-3701-4848-ac73-61d18c1567cc controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:52:368.645 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:368.683 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:410.586 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:410.790 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:410.820 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:448.258 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:495.910 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:496.036 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0079e53f-93b7-4394-8e4c-bc72f1da06b3 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:37:52:532.460 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:532.676 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-route-table controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:687.997 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:688.144 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:52:688.184 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:756.213 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:806.104 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:917.797 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:52:918.040 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__1__right__1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:52:918.113 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:918.149 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:918.188 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:918.216 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:52:989.293 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:53:042.677 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:53:156.587 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:53:156.801 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562-right controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:53:156.868 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:53:967.672 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:055.647 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:151.808 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:210.076 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:210.308 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:54:340.651 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:340.922 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__1__left__2 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:54:340.993 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:54:341.046 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:54:341.092 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:54:341.153 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:54:433.096 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:479.330 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:575.236 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:575.452 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562-left controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:54:575.518 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:54:652.406 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:720.054 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:787.375 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:831.632 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:831.839 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:54:879.587 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:879.786 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:54:911.359 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:911.476 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance a05bc034-37ef-403f-b35d-6ffe52500571 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:37:54:985.853 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:995.893 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:54:996.119 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:54:996.174 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402346686208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:118.764 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:118.972 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2__right__1 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:55:119.022 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:119.053 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:119.080 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:119.102 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:187.605 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:225.152 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:305.588 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:358.211 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:419.638 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:466.284 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402338289408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:519.437 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:519.675 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:606.655 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:606.852 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2__left__2 controller/src/ifmap/ifmap_server_table.cc 95 2025-02-13 Thu 02:37:55:606.892 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:606.925 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:606.950 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:606.973 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:664.518 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:704.029 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:784.093 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402334091008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:827.412 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:888.577 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:912.586 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:957.888 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:958.112 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:55:998.469 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:37:55:998.679 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-02-13 Thu 02:37:58:462.125 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.8:55284 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:37:59:926.010 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.35:51884 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:38:00:031.827 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402581633152, Pid 113620]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.6:8092::10.20.0.6:41914 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-02-13 Thu 02:38:09:251.755 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:09:251.962 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:252.009 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router:default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772 - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:08286d29-7318-43a2-87c3-ce549b0ce019 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:326.633 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:09:326.768 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0079e53f-93b7-4394-8e4c-bc72f1da06b3 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:38:09:364.258 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:364.314 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:364.328 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:c3c4f0c1-ff60-45b7-96c3-dfc2d9edf72b controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:09:364.352 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:c3c4f0c1-ff60-45b7-96c3-dfc2d9edf72b - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:08286d29-7318-43a2-87c3-ce549b0ce019 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:364.375 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:c3c4f0c1-ff60-45b7-96c3-dfc2d9edf72b - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-vn-47525958 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:444.166 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:444.233 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:444.276 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:08286d29-7318-43a2-87c3-ce549b0ce019 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:09:444.308 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:08286d29-7318-43a2-87c3-ce549b0ce019 - project:default-domain:ctest-TestRoutersBasic-74813182 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:444.352 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:08286d29-7318-43a2-87c3-ce549b0ce019 - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-vn-47525958 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:567.110 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:09:567.306 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:567.333 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:567.347 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting logical-router-virtual-network:attr(default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226,default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772) controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:09:567.374 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router:default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772 - logical-router-virtual-network:attr(default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226,default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:567.397 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router-virtual-network:attr(default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226,default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772) - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:666.688 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:09:666.912 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:666.945 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:667.001 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router:default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772 - route-table:default-domain:ctest-TestRoutersBasic-74813182:rt_986baa77-1cc5-48fb-881b-f2164f3bec0c , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:667.031 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router:default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772 - service-instance:default-domain:ctest-TestRoutersBasic-74813182:snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:696.771 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:696.822 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting logical-router:default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:09:696.861 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router:default-domain:ctest-TestRoutersBasic-74813182:ctest-router1-75507772 - project:default-domain:ctest-TestRoutersBasic-74813182 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:740.364 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:09:740.495 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance a05bc034-37ef-403f-b35d-6ffe52500571 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:38:09:780.098 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:09:812.332 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:812.397 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting route-table:default-domain:ctest-TestRoutersBasic-74813182:rt_986baa77-1cc5-48fb-881b-f2164f3bec0c controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:09:812.430 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove route-table:default-domain:ctest-TestRoutersBasic-74813182:rt_986baa77-1cc5-48fb-881b-f2164f3bec0c - project:default-domain:ctest-TestRoutersBasic-74813182 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:887.613 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:09:887.809 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:887.890 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__1__left__2 - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:09:982.137 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:09:982.345 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:09:982.381 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2__left__2 - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:092.707 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:092.763 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:092.794 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:092.808 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562-left controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:10:092.840 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562-left - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__1__left__2 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:092.874 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562-left - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2__left__2 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:092.899 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402423568128, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562-left - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:146.934 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:146.983 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting floating-ip-pool:default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226:floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:10:147.010 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip-pool:default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226:floating-ip-pool - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:259.658 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:259.767 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:259.798 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:259.819 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:10:259.837 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:10:259.871 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 - project:default-domain:ctest-TestRoutersBasic-74813182 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:259.905 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 - virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:259.931 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-74813182:snat-si-left_snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:329.944 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:10:377.721 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:10:433.083 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance a05bc034-37ef-403f-b35d-6ffe52500571 controller/src/ifmap/client/config_json_parser.cc 223 2025-02-13 Thu 02:38:10:546.175 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:546.253 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:546.283 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove service-instance:default-domain:ctest-TestRoutersBasic-74813182:snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 - project:default-domain:ctest-TestRoutersBasic-74813182 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:546.304 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove service-instance:default-domain:ctest-TestRoutersBasic-74813182:snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562 - service-template:default-domain:netns-snat-template , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:705.647 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:705.702 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:705.716 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:d203fcd4-3701-4848-ac73-61d18c1567cc controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:10:705.741 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:d203fcd4-3701-4848-ac73-61d18c1567cc - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:021ec554-0065-45a9-888c-3cc727f88830 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:705.763 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:d203fcd4-3701-4848-ac73-61d18c1567cc - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:815.976 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:10:816.193 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:816.231 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402419369728, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562-right - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2__right__1 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:830.622 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402304702208, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:10:884.559 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:884.614 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:884.784 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:37756c08-31e6-4d43-ad39-1c558523d3e1 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:10:884.812 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:37756c08-31e6-4d43-ad39-1c558523d3e1 - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:53c0efe6-9670-4abd-a70e-8538004e8a73 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:884.878 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:37756c08-31e6-4d43-ad39-1c558523d3e1 - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-vn-47525958 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:939.895 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:939.956 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:939.981 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:940.014 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:10:940.029 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:021ec554-0065-45a9-888c-3cc727f88830 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:10:940.053 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:021ec554-0065-45a9-888c-3cc727f88830 - project:default-domain:ctest-TestRoutersBasic-74813182 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:940.076 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:021ec554-0065-45a9-888c-3cc727f88830 - security-group:default-domain:ctest-TestRoutersBasic-74813182:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:940.091 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:021ec554-0065-45a9-888c-3cc727f88830 - virtual-machine:52e5387e-0103-4627-bb92-3be0d24d6954 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:940.105 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402308900608, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:021ec554-0065-45a9-888c-3cc727f88830 - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:10:984.564 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-02-13 Thu 02:38:11:006.161 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402342487808, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:52e5387e-0103-4627-bb92-3be0d24d6954 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:11:044.903 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:11:044.979 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:11:045.114 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:11:045.149 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:11:045.167 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2__right__1 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:11:045.201 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2__right__1 - project:default-domain:ctest-TestRoutersBasic-74813182 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:11:045.233 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2__right__1 - security-group:default-domain:ctest-TestRoutersBasic-74813182:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:11:045.269 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2__right__1 - virtual-machine:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:11:045.295 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402325694208, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:default-domain__ctest-TestRoutersBasic-74813182__snat_986baa77-1cc5-48fb-881b-f2164f3bec0c_b958951a-f6c8-4130-a980-89db244e5562__2__right__1 - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-ext_vn-40749226 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:11:126.865 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:11:126.936 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:11:126.962 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:11:126.984 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:11:126.997 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:53c0efe6-9670-4abd-a70e-8538004e8a73 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:11:127.028 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:53c0efe6-9670-4abd-a70e-8538004e8a73 - project:default-domain:ctest-TestRoutersBasic-74813182 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:11:127.066 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:53c0efe6-9670-4abd-a70e-8538004e8a73 - security-group:default-domain:ctest-TestRoutersBasic-74813182:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:11:127.086 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:53c0efe6-9670-4abd-a70e-8538004e8a73 - virtual-machine:35070365-bf60-41fa-a049-d7c7a3d4ca51 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:11:127.103 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402313099008, Pid 113620]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-74813182:53c0efe6-9670-4abd-a70e-8538004e8a73 - virtual-network:default-domain:ctest-TestRoutersBasic-74813182:ctest-vn-47525958 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-02-13 Thu 02:38:11:181.412 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402329892608, Pid 113620]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:35070365-bf60-41fa-a049-d7c7a3d4ca51 controller/src/ifmap/ifmap_server_table.cc 164 2025-02-13 Thu 02:38:11:214.750 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-02-13 Thu 02:38:11:214.807 UTC cn-jenkins-deploy-platform-ansible-os-2728-2 [Thread 140402317297408, Pid 113620]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145