2025-01-20 Mon 01:48:43:594.543 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:686.006 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:777.932 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:860.162 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:43:936.889 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:012.691 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:090.614 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:090.769 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile d21e436e-e28f-4769-9584-9728f9b6c801 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 01:48:44:174.881 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:174.996 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile d21e436e-e28f-4769-9584-9728f9b6c801 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 01:48:44:254.499 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:254.675 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 18968228-aaec-4c03-8443-b0ef809a5b19 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 01:48:44:334.154 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:419.768 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:500.168 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:582.210 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:669.002 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:757.458 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:841.090 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:44:924.423 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:013.531 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:113.190 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:215.485 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:297.177 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:383.081 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:464.404 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:539.479 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:622.434 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:700.677 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:791.538 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:863.499 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:45:942.002 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:019.524 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:095.748 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:175.511 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:265.563 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:351.283 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:465.989 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:46:521.641 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:48:58:747.217 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:38026 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:48:59:885.504 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:38032 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:50:15:044.490 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:55068::10.0.0.42:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-20 Mon 01:50:15:044.530 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:55068::10.0.0.42:8086(-1):EvTcpClose 2025-01-20 Mon 01:50:15:044.617 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvTcpClose in state Established 2025-01-20 Mon 01:50:15:044.644 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Established : EvTcpClose 2025-01-20 Mon 01:50:15:044.945 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Connect : Start Connect timer 10.0.0.49:8086 2025-01-20 Mon 01:50:15:045.049 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:15:045.302 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337815044751 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Established successful_connections = 1 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = cn-jenkins-deploy-platform-ansible-os-2650-1. collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 196301 calls = 15 average_bytes = 13086 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1432, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 14, _iter59->first = sent _iter59->second = 17, ] ] ] 2025-01-20 Mon 01:50:15:045.326 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:15:045.339 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:15:045.365 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337815044796 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Established : EvTcpClose -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:15:045.373 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:15:045.382 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvTcpDeleteSession in state Connect 2025-01-20 Mon 01:50:15:045.418 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:15:045.644 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337815045033 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 1 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 196301 calls = 15 average_bytes = 13086 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1432, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 14, _iter59->first = sent _iter59->second = 17, ] ] ] 2025-01-20 Mon 01:50:15:045.664 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:15:048.443 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.49:41616::10.0.0.49:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-20 Mon 01:50:15:048.471 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:41616::10.0.0.49:8086(-1) OnSessionEvent TCP Connected 2025-01-20 Mon 01:50:15:048.479 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:41616::10.0.0.49:8086(-1):EvTcpConnected 2025-01-20 Mon 01:50:15:048.536 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvTcpConnected in state Connect 2025-01-20 Mon 01:50:15:048.574 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-20 Mon 01:50:15:048.630 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ClientInit 2025-01-20 Mon 01:50:15:048.655 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2650-3:contrail-dns:0:Control count 2 2025-01-20 Mon 01:50:15:048.781 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:15:048.791 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-20 Mon 01:50:15:048.819 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: SANDESH: Send FAILED: 1737337815048621 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.49:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:15:048.866 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Received UVE message in wrong state : NodeStatusUVE 2025-01-20 Mon 01:50:15:048.892 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:15:048.919 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-20 Mon 01:50:15:048.937 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:15:048.945 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-20 Mon 01:50:15:049.178 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: SANDESH: Send FAILED: 1737337815048765 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 2 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 196301 calls = 15 average_bytes = 13086 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1433, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 17, _iter59->first = sent _iter59->second = 17, ] ] ] 2025-01-20 Mon 01:50:15:049.198 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-20 Mon 01:50:15:147.140 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.49:41616::10.0.0.49:8086(-1) < Read failed due to error system 104 : Connection reset by peer src/contrail-common/io/tcp_session.cc 507 2025-01-20 Mon 01:50:15:147.194 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.49:41616::10.0.0.49:8086(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 01:50:15:147.217 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:41616::10.0.0.49:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-20 Mon 01:50:15:147.226 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:41616::10.0.0.49:8086(-1):EvTcpClose 2025-01-20 Mon 01:50:15:147.288 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Processing scm::EvTcpClose in state ClientInit 2025-01-20 Mon 01:50:15:147.303 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ClientInit : EvTcpClose 2025-01-20 Mon 01:50:15:147.474 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Return to idle with 5000 2025-01-20 Mon 01:50:15:147.491 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Idle 2025-01-20 Mon 01:50:15:147.565 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:15:151.458 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SANDESH: Send FAILED: 1737337815147415 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 2 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 197911 calls = 16 average_bytes = 12369 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1435, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19, _iter59->first = sent _iter59->second = 18, ] ] ] 2025-01-20 Mon 01:50:15:151.556 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:15:151.591 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:15:151.636 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SANDESH: Send FAILED: 1737337815147457 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.49:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:15:151.649 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:15:151.664 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 01:50:15:151.742 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:15:152.129 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SANDESH: Send FAILED: 1737337815147551 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 2 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 197911 calls = 16 average_bytes = 12369 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1435, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19, _iter59->first = sent _iter59->second = 18, ] ] ] 2025-01-20 Mon 01:50:15:152.162 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:20:147.596 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 01:50:20:147.792 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-20 Mon 01:50:20:147.917 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:20:147.950 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337820147671 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:20:147.960 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:20:147.969 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:20:148.186 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337820147900 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 2 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 197911 calls = 16 average_bytes = 12369 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1435, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 22, _iter59->first = sent _iter59->second = 18, ] ] ] 2025-01-20 Mon 01:50:20:148.217 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:20:150.497 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.49:44328::10.0.0.22:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-20 Mon 01:50:20:150.520 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:44328::10.0.0.22:8086(-1) OnSessionEvent TCP Connected 2025-01-20 Mon 01:50:20:150.528 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:44328::10.0.0.22:8086(-1):EvTcpConnected 2025-01-20 Mon 01:50:20:150.587 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Processing scm::EvTcpConnected in state Connect 2025-01-20 Mon 01:50:20:150.615 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-20 Mon 01:50:20:150.658 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ClientInit 2025-01-20 Mon 01:50:20:150.677 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2650-3:contrail-dns:0:Control count 3 2025-01-20 Mon 01:50:20:150.808 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:20:150.819 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-20 Mon 01:50:20:150.846 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: SANDESH: Send FAILED: 1737337820150649 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:20:150.854 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Received UVE message in wrong state : NodeStatusUVE 2025-01-20 Mon 01:50:20:150.863 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:20:150.870 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-20 Mon 01:50:20:150.882 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:20:150.888 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-20 Mon 01:50:20:151.123 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: SANDESH: Send FAILED: 1737337820150794 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 3 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 197911 calls = 16 average_bytes = 12369 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1436, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 24, _iter59->first = sent _iter59->second = 18, ] ] ] 2025-01-20 Mon 01:50:20:151.142 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-20 Mon 01:50:20:153.049 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:44328::10.0.0.22:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-20 Mon 01:50:20:153.072 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:44328::10.0.0.22:8086(-1):EvTcpClose 2025-01-20 Mon 01:50:20:153.118 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvTcpClose in state ClientInit 2025-01-20 Mon 01:50:20:153.140 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ClientInit : EvTcpClose 2025-01-20 Mon 01:50:20:153.273 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Return to idle with 5000 2025-01-20 Mon 01:50:20:153.282 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Idle 2025-01-20 Mon 01:50:20:153.351 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:20:153.571 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337820153229 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 3 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 199521 calls = 17 average_bytes = 11736 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1436, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-01-20 Mon 01:50:20:153.607 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:20:153.618 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:20:153.643 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337820153260 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:20:153.650 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:20:153.660 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 01:50:20:153.686 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:20:154.261 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337820153336 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 3 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 199521 calls = 17 average_bytes = 11736 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1436, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-01-20 Mon 01:50:20:154.293 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:22:274.225 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:22:274.338 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: SANDESH: Send FAILED: 1737337822274027 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 48 dequeues = 48 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 61 dequeues = 61 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737337820153280 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737337820153684 ] max_sm_queue_count = 5 ] 2025-01-20 Mon 01:50:22:274.371 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:22:274.383 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:22:274.653 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: SANDESH: Send FAILED: 1737337822274174 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 3 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 199521 calls = 17 average_bytes = 11736 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1436, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 29, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-01-20 Mon 01:50:22:274.677 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:25:153.394 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 01:50:25:153.684 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Connect : Start Connect timer 10.0.0.42:8086 2025-01-20 Mon 01:50:25:153.825 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:25:153.858 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: SANDESH: Send FAILED: 1737337825153478 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:25:153.874 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:25:153.884 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:25:154.164 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: SANDESH: Send FAILED: 1737337825153809 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 3 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 199521 calls = 17 average_bytes = 11736 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1436, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 31, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-01-20 Mon 01:50:25:154.187 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:25:157.108 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.49:46466::10.0.0.42:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-20 Mon 01:50:25:157.150 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:46466::10.0.0.42:8086(-1) OnSessionEvent TCP Connected 2025-01-20 Mon 01:50:25:157.164 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:46466::10.0.0.42:8086(-1):EvTcpConnected 2025-01-20 Mon 01:50:25:157.416 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Processing scm::EvTcpConnected in state Connect 2025-01-20 Mon 01:50:25:157.441 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-20 Mon 01:50:25:157.499 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ClientInit 2025-01-20 Mon 01:50:25:157.522 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2650-3:contrail-dns:0:Control count 4 2025-01-20 Mon 01:50:25:157.696 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:25:157.722 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-20 Mon 01:50:25:157.760 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: SANDESH: Send FAILED: 1737337825157486 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:25:157.772 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Received UVE message in wrong state : NodeStatusUVE 2025-01-20 Mon 01:50:25:157.787 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:25:157.799 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-20 Mon 01:50:25:157.815 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:50:25:157.826 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-20 Mon 01:50:25:158.200 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: SANDESH: Send FAILED: 1737337825157676 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 199521 calls = 17 average_bytes = 11736 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1437, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-01-20 Mon 01:50:25:158.234 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-20 Mon 01:50:28:001.501 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.49:46466::10.0.0.42:8086(-1) < Read failed due to error system 104 : Connection reset by peer src/contrail-common/io/tcp_session.cc 507 2025-01-20 Mon 01:50:28:001.559 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.49:46466::10.0.0.42:8086(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 01:50:28:001.609 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:46466::10.0.0.42:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-20 Mon 01:50:28:001.622 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:46466::10.0.0.42:8086(-1):EvTcpClose 2025-01-20 Mon 01:50:28:001.676 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvTcpClose in state ClientInit 2025-01-20 Mon 01:50:28:001.691 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ClientInit : EvTcpClose 2025-01-20 Mon 01:50:28:001.852 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Return to idle with 5000 2025-01-20 Mon 01:50:28:001.862 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Idle 2025-01-20 Mon 01:50:28:001.940 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:28:002.190 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: SANDESH: Send FAILED: 1737337828001800 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:28:002.213 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:28:002.224 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:28:002.251 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: SANDESH: Send FAILED: 1737337828001837 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:28:002.262 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:28:002.271 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 01:50:28:002.297 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:28:002.522 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: SANDESH: Send FAILED: 1737337828001925 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:28:002.539 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:33:001.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 01:50:33:002.228 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Connect : Start Connect timer 10.0.0.49:8086 2025-01-20 Mon 01:50:33:002.245 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 01:50:33:002.271 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: -(-1):EvTcpConnectFail 2025-01-20 Mon 01:50:33:002.371 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:33:002.411 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: SANDESH: Send FAILED: 1737337833002065 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.49:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:33:002.425 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:33:002.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 01:50:33:002.459 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Connect : EvTcpConnectFail 2025-01-20 Mon 01:50:33:002.609 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 01:50:33:002.672 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Idle 2025-01-20 Mon 01:50:33:002.789 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:33:003.150 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: SANDESH: Send FAILED: 1737337833002351 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 38, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:33:003.177 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:33:003.189 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:33:003.408 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: SANDESH: Send FAILED: 1737337833002528 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 39, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:33:004.308 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:33:004.321 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:33:004.346 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: SANDESH: Send FAILED: 1737337833002562 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:33:004.354 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:33:004.363 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 01:50:33:004.384 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:33:004.611 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: SANDESH: Send FAILED: 1737337833002766 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 39, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:33:004.629 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:41:002.779 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 01:50:41:002.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-20 Mon 01:50:41:003.133 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:41:003.165 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: SANDESH: Send FAILED: 1737337841002852 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:41:003.174 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:41:003.183 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:41:003.411 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: SANDESH: Send FAILED: 1737337841003115 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 43, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:41:003.444 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:41:003.464 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 01:50:41:003.488 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: -(-1):EvTcpConnectFail 2025-01-20 Mon 01:50:41:003.547 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 01:50:41:003.576 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Connect : EvTcpConnectFail 2025-01-20 Mon 01:50:41:003.739 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 01:50:41:003.804 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Idle 2025-01-20 Mon 01:50:41:003.885 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:41:004.107 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: SANDESH: Send FAILED: 1737337841003685 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:41:004.129 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:41:004.141 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:41:004.165 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: SANDESH: Send FAILED: 1737337841003717 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:41:004.173 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:41:004.182 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 01:50:41:004.205 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:41:004.412 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: SANDESH: Send FAILED: 1737337841003873 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:41:004.431 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:52:274.508 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:52:274.663 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337852274328 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 68 dequeues = 68 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 91 dequeues = 91 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737337841003801 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737337841004203 ] max_sm_queue_count = 5 ] 2025-01-20 Mon 01:50:52:274.680 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:52:274.692 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:52:274.956 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337852274456 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 48, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:52:275.011 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:57:004.102 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 01:50:57:004.283 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Connect : Start Connect timer 10.0.0.42:8086 2025-01-20 Mon 01:50:57:004.405 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:57:004.437 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: SANDESH: Send FAILED: 1737337857004176 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:57:004.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:57:004.456 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:50:57:004.716 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: SANDESH: Send FAILED: 1737337857004388 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 50, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:57:004.746 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:57:004.758 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 01:50:57:004.785 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: -(-1):EvTcpConnectFail 2025-01-20 Mon 01:50:57:004.840 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 01:50:57:004.862 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Connect : EvTcpConnectFail 2025-01-20 Mon 01:50:57:005.013 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 01:50:57:005.059 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Idle 2025-01-20 Mon 01:50:57:005.138 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:57:005.369 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: SANDESH: Send FAILED: 1737337857004962 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:57:005.393 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:50:57:005.405 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:57:005.433 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: SANDESH: Send FAILED: 1737337857004990 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:50:57:005.448 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:50:57:005.462 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 01:50:57:005.488 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:50:57:005.824 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: SANDESH: Send FAILED: 1737337857005125 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1442, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:50:57:005.847 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:22:274.820 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:51:22:274.941 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: SANDESH: Send FAILED: 1737337882274630 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 75 dequeues = 75 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 101 dequeues = 101 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737337857005057 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737337857005486 ] max_sm_queue_count = 5 ] 2025-01-20 Mon 01:51:22:274.957 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:22:274.981 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:51:22:275.215 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: SANDESH: Send FAILED: 1737337882274774 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1442, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 55, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:51:22:275.234 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:27:005.164 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 01:51:27:005.496 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Connect : Start Connect timer 10.0.0.49:8086 2025-01-20 Mon 01:51:27:005.686 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:51:27:005.727 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SANDESH: Send FAILED: 1737337887005243 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.49:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:51:27:005.738 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:51:27:005.748 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:51:27:005.985 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SANDESH: Send FAILED: 1737337887005659 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.49:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1442, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 57, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:51:27:006.011 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:27:006.402 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 01:51:27:006.419 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: -(-1):EvTcpConnectFail 2025-01-20 Mon 01:51:27:006.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 01:51:27:006.458 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Connect : EvTcpConnectFail 2025-01-20 Mon 01:51:27:006.611 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 01:51:27:006.645 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Idle 2025-01-20 Mon 01:51:27:006.718 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:51:27:007.069 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: SANDESH: Send FAILED: 1737337887006548 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1442, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:51:27:007.113 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:27:007.135 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:51:27:007.173 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: SANDESH: Send FAILED: 1737337887006591 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:51:27:007.185 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:51:27:007.198 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 01:51:27:007.231 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:51:27:007.468 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: SANDESH: Send FAILED: 1737337887006707 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 647 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:51:27:007.490 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:36:367.652 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:36:642.177 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:37:315.531 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:37:417.721 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:37:712.688 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:37:940.147 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:41:294.721 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:41:525.024 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:41:837.021 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:46:688.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:52:203.768 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:52:243.425 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:52:275.092 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:51:52:275.233 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337912274895 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 82 dequeues = 82 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 111 dequeues = 111 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737337887006644 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737337887007229 ] max_sm_queue_count = 5 ] 2025-01-20 Mon 01:51:52:275.268 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:52:275.283 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:51:52:275.673 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337912275052 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 659 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1455, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 62, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:51:52:275.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:52:285.709 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:019.648 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:094.340 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:159.124 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:203.865 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:281.642 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:354.556 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:388.630 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:450.042 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:522.203 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:556.518 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:610.544 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:722.411 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:751.930 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:813.736 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:906.736 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:54:989.245 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:015.430 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:109.128 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:177.167 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:193.452 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:330.790 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:379.474 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:414.081 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:543.935 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:572.137 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:595.270 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:713.829 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:801.868 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:806.067 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:55:957.284 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:027.541 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:048.582 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:146.789 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:221.803 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:249.981 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:330.301 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:397.849 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:428.952 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:529.622 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:598.668 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:611.423 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:746.504 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:809.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:817.991 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:950.302 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:56:995.146 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:006.744 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 01:51:57:006.960 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-20 Mon 01:51:57:007.079 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:51:57:007.125 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337917006821 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:51:57:007.135 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:51:57:007.176 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:51:57:007.202 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-20 Mon 01:51:57:007.234 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: -(-1):EvTcpConnectFail 2025-01-20 Mon 01:51:57:007.406 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337917007061 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 706 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1502, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 64, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:51:57:007.428 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:57:007.439 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvTcpConnectFail in state Connect 2025-01-20 Mon 01:51:57:007.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Connect : EvTcpConnectFail 2025-01-20 Mon 01:51:57:007.571 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-20 Mon 01:51:57:007.618 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Idle 2025-01-20 Mon 01:51:57:007.693 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:51:57:007.905 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337917007525 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 706 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1502, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:51:57:007.923 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:57:007.933 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:51:57:007.956 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337917007550 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:51:57:007.963 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:51:57:007.972 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-20 Mon 01:51:57:007.993 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:51:57:008.219 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337917007680 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 706 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 19 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1503, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:51:57:008.239 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:51:57:016.285 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:134.130 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:163.718 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:190.310 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:313.333 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:339.717 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:369.752 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065449690880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:496.074 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:514.167 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065432897280, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:532.154 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:666.205 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:694.931 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:706.897 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:869.236 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:895.254 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065441294080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:57:919.833 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:58:040.549 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:58:076.274 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:58:110.317 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:58:211.941 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065466484480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:58:246.754 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:58:274.124 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:58:374.382 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:59:658.278 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:43592 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:51:59:713.484 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:59:744.622 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:51:59:782.046 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:52:00:946.684 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:53982 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:52:01:101.970 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:42858 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:52:08:555.942 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:52:08:578.512 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:52:09:052.542 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:52:19:713.697 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065445492480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:52:19:763.856 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065424500480, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:52:19:793.872 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:52:22:275.396 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:52:22:275.508 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: SANDESH: Send FAILED: 1737337942275227 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 89 dequeues = 89 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 121 dequeues = 121 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737337917007616 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737337917007991 ] max_sm_queue_count = 5 ] 2025-01-20 Mon 01:52:22:275.536 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:52:22:275.547 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: Processing scm::EvSandeshSend in state Idle 2025-01-20 Mon 01:52:22:275.794 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: SANDESH: Send FAILED: 1737337942275364 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 738 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 22 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1538, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 69, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:52:22:275.837 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:52:25:906.844 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:38186 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:52:26:038.102 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:32978 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:52:27:007.941 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-20 Mon 01:52:27:008.167 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Connect : Start Connect timer 10.0.0.42:8086 2025-01-20 Mon 01:52:27:008.299 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:52:27:008.332 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337947008037 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:52:27:008.353 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:52:27:008.363 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:52:27:008.592 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SANDESH: Send FAILED: 1737337947008281 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 738 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 24 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1540, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 71, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:52:27:008.611 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:52:27:010.957 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.49:57996::10.0.0.42:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-20 Mon 01:52:27:010.982 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:57996::10.0.0.42:8086(-1) OnSessionEvent TCP Connected 2025-01-20 Mon 01:52:27:010.991 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: 10.0.0.49:57996::10.0.0.42:8086(-1):EvTcpConnected 2025-01-20 Mon 01:52:27:011.279 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvTcpConnected in state Connect 2025-01-20 Mon 01:52:27:011.291 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-20 Mon 01:52:27:011.329 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ClientInit 2025-01-20 Mon 01:52:27:011.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2650-3:contrail-dns:0:Control count 5 2025-01-20 Mon 01:52:27:011.437 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:52:27:011.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-20 Mon 01:52:27:011.480 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: SANDESH: Send FAILED: 1737337947011321 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:52:27:011.488 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Received UVE message in wrong state : NodeStatusUVE 2025-01-20 Mon 01:52:27:011.497 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:52:27:011.504 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-20 Mon 01:52:27:011.515 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:52:27:011.522 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-20 Mon 01:52:27:011.749 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: SANDESH: Send FAILED: 1737337947011425 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 5 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 738 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1541, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 73, _iter59->first = sent _iter59->second = 20, ] ] ] 2025-01-20 Mon 01:52:27:011.769 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065428698880, Pid 76749]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-20 Mon 01:52:27:027.677 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: OnMessage control in state: ClientInit 2025-01-20 Mon 01:52:27:027.742 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-01-20 Mon 01:52:27:027.752 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: ClientInit : EvSandeshMessageRecv 2025-01-20 Mon 01:52:27:027.791 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Received Ctrl Message with size 0 2025-01-20 Mon 01:52:27:027.813 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2650-3 start_time = 1737337642874128 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-16 00:14:43.877305","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7545-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.42:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.18, ] ] proxy seq 1 2025-01-20 Mon 01:52:27:027.827 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 01:52:27:028.127 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 5 pid = 76749 http_port = 8092 start_time = 1737337642270779 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 201131 calls = 18 average_bytes = 11173 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 89 dequeues = 89 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 121 dequeues = 121 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737337917007616 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737337917007991 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 15 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 167076 calls = 13 average_bytes = 12852 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 738 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1541, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 73, _iter59->first = sent _iter59->second = 20, ] ] max_sm_queue_count = 5 proxy seq 56 2025-01-20 Mon 01:52:27:028.158 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 01:52:27:028.185 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 33 2025-01-20 Mon 01:52:27:028.198 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 01:52:27:028.209 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:52:27:028.216 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:52:27:028.225 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:52:27:028.260 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: Established 2025-01-20 Mon 01:52:27:184.939 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:59440 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:52:36:724.678 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: OnMessage control in state: Established 2025-01-20 Mon 01:52:36:724.737 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Processing scm::EvSandeshMessageRecv in state Established 2025-01-20 Mon 01:52:36:724.749 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Established : EvSandeshMessageRecv 2025-01-20 Mon 01:52:36:724.799 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: Received Ctrl Message with size 3 2025-01-20 Mon 01:52:36:724.813 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SyncAllMaps for DnsState:0 period 0 cycle 0 with seqno 1, total = 0 2025-01-20 Mon 01:52:36:724.824 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 57, total = 0 2025-01-20 Mon 01:52:36:724.834 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 35, total = 0 2025-01-20 Mon 01:52:36:724.842 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:52:36:724.849 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:52:36:724.878 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065437095680, Pid 76749]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:53:06:737.161 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-3:10.20.0.8 SEND Xmpp creating dynamic channel 10.20.0.18:8093::10.20.0.8:43451 controller/src/xmpp/xmpp_server.cc 586 2025-01-20 Mon 01:53:06:737.261 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-3:10.20.0.8 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2650-3 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-20 Mon 01:53:06:737.307 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8093::10.20.0.8:43451 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:53:06:737.381 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-3:10.20.0.8 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.8 ( ) controller/src/xmpp/xmpp_state_machine.cc 1326 2025-01-20 Mon 01:53:06:737.478 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:53:06:738.029 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 43451 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:53:06:738.100 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065453889280, Pid 76749]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.8 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2650-2/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:53:07:095.339 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-3:10.20.0.13 SEND Xmpp creating dynamic channel 10.20.0.18:8093::10.20.0.13:34185 controller/src/xmpp/xmpp_server.cc 586 2025-01-20 Mon 01:53:07:095.402 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-3:10.20.0.13 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2650-3 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-20 Mon 01:53:07:095.920 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2650-3:10.20.0.13 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.13 ( ) controller/src/xmpp/xmpp_state_machine.cc 1326 2025-01-20 Mon 01:53:07:095.980 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:53:07:096.063 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065416103680, Pid 76749]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 34185 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:53:07:096.557 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065622411392, Pid 76749]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8093::10.20.0.13:34185 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-20 Mon 01:53:07:097.174 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.13 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2650-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1710 2025-01-20 Mon 01:53:34:006.385 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065420302080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:54:15:676.385 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 140065462286080, Pid 76749]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-20 Mon 01:55:00:471.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_INFO]: VersionInfoLog: {"build-info":[{"build-version":"nightly","build-time":"2025-01-20 00:19:43.682579","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7550-1.novalocal","build-id":"unknown","build-number":"unknown"}]} src/contrail-common/base/misc_utils.cc 41 2025-01-20 Mon 01:55:00:472.103 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: ROLE : Generator 2025-01-20 Mon 01:55:00:472.119 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: MODULE : contrail-dns 2025-01-20 Mon 01:55:00:472.128 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-2650-3 2025-01-20 Mon 01:55:00:472.135 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: NODE TYPE : Control 2025-01-20 Mon 01:55:00:472.164 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: INSTANCE ID : 0 2025-01-20 Mon 01:55:00:472.174 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: HTTP SERVER PORT : 8092 2025-01-20 Mon 01:55:00:472.183 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-01-20 Mon 01:55:00:472.610 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: HTTP Introspect Init 2025-01-20 Mon 01:55:00:474.073 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8092 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-01-20 Mon 01:55:00:474.211 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: Sandesh Http Server Port: 8092 2025-01-20 Mon 01:55:00:474.301 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: NOT Writing http_port 8092TO : /tmp/contrail-dns.106003.http_port 2025-01-20 Mon 01:55:00:474.316 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: CONNECT TO COLLECTOR: 1 2025-01-20 Mon 01:55:00:474.488 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: Idle 2025-01-20 Mon 01:55:00:474.876 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: No Client: 1737338100474699 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 106128 http_port = 8092 start_time = 1737338100474503 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 01:55:00:475.113 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: Logging: DISABLED -> ENABLED 2025-01-20 Mon 01:55:00:475.136 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-01-20 Mon 01:55:00:475.277 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: Processing scm::EvStart in state Idle 2025-01-20 Mon 01:55:00:475.315 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: Disconnect 2025-01-20 Mon 01:55:00:475.631 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: Processing scm::EvCollectorUpdate in state Disconnect 2025-01-20 Mon 01:55:00:476.480 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: Connect : Start Connect timer 10.0.0.42:8086 2025-01-20 Mon 01:55:00:476.619 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:55:00:477.183 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: SANDESH: Send FAILED: 1737338100475612 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 106128 http_port = 8092 start_time = 1737338100474503 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 01:55:00:477.216 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:55:00:477.233 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:55:00:477.372 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: SANDESH: Send FAILED: 1737338100475921 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 106128 http_port = 8092 start_time = 1737338100474503 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 01:55:00:477.390 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:55:00:477.405 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:55:00:477.523 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: SANDESH: Send FAILED: 1737338100476602 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 106128 http_port = 8092 start_time = 1737338100474503 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 01:55:00:477.540 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-20 Mon 01:55:00:602.463 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: Applying named configuration failed 2025-01-20 Mon 01:55:00:602.880 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.20.0.18:8093 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-01-20 Mon 01:55:00:602.967 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been started controller/src/dns/main.cc 384 2025-01-20 Mon 01:55:00:603.049 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 303 2025-01-20 Mon 01:55:00:603.161 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-01-20 Mon 01:55:00:603.173 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-01-20 Mon 01:55:00:603.332 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:55:00:603.375 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: SANDESH: Send FAILED: 1737338100603138 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-01-20 Mon 01:55:00:603.385 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:55:00:772.593 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-01-20 Mon 01:55:00:772.654 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:55:00:772.659 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 307 2025-01-20 Mon 01:55:00:772.758 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 580 2025-01-20 Mon 01:55:00:772.782 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-01-20 Mon 01:55:00:774.549 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: SANDESH: Send FAILED: 1737338100772534 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-01-20 Mon 01:55:00:774.611 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:55:00:774.634 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:55:00:774.673 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: SANDESH: Send FAILED: 1737338100772744 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down ], ] ] ] 2025-01-20 Mon 01:55:00:774.685 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:55:00:812.285 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 95 2025-01-20 Mon 01:55:00:814.396 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 104 2025-01-20 Mon 01:55:00:814.449 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 110 2025-01-20 Mon 01:55:00:814.534 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:814.546 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 393 2025-01-20 Mon 01:55:00:814.684 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:55:00:814.749 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: SANDESH: Send FAILED: 1737338100814488 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:55:00:814.764 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:55:00:817.507 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:830.050 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:837.599 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:839.479 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:842.242 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:853.070 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:883.909 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:888.849 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:891.547 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:894.223 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:897.429 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:900.475 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:902.552 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:904.502 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:905.798 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:907.170 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:909.129 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:913.037 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:916.030 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:918.184 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:919.544 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:920.941 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:923.502 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:925.997 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:929.686 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:931.911 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:934.712 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:935.900 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:938.167 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:946.229 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:948.191 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:949.669 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:952.335 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:954.056 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:955.972 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:969.426 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:971.856 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:973.239 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:974.418 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:975.373 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:976.457 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:994.715 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:00:997.547 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:000.124 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:003.832 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:006.001 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:016.015 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:029.018 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:030.421 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:036.015 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:042.933 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:046.796 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:060.621 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:066.308 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:072.230 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:074.918 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:077.823 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:079.465 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:080.732 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:093.124 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:094.660 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:102.061 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:119.587 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:124.527 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:127.616 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:153.855 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:155.479 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:157.095 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:167.083 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:169.677 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:172.165 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:197.205 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:199.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:201.673 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:221.930 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:224.942 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:226.867 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:262.971 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:264.227 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:266.257 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:272.757 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:274.412 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:279.875 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:289.267 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:296.179 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:299.045 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:307.627 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:312.716 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:315.221 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:324.750 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:327.462 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:332.922 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:334.837 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:341.197 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:351.673 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:358.849 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:360.161 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:362.295 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:367.168 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:368.637 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:388.964 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:410.808 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:415.494 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:417.228 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:421.592 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:423.170 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:434.149 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:440.423 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:442.412 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:444.111 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:446.737 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:448.009 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:449.645 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:452.088 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:453.344 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:455.043 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:459.484 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:461.615 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:461.729 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-20 Mon 01:55:01:462.073 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-20 Mon 01:55:01:462.359 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-20 Mon 01:55:01:462.741 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-20 Mon 01:55:01:463.026 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-20 Mon 01:55:01:463.296 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-20 Mon 01:55:01:463.534 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-20 Mon 01:55:01:463.822 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 554 2025-01-20 Mon 01:55:01:463.862 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 197 2025-01-20 Mon 01:55:01:464.117 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:55:01:464.178 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: SANDESH: Send FAILED: 1737338101463894 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:55:01:464.194 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:55:01:465.489 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 225 2025-01-20 Mon 01:55:01:474.862 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:475.664 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:475.732 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:475.761 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:475.778 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:475.810 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:475.831 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:475.851 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5600 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:475.864 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:475.895 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:475.917 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:480.845 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:482.769 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:482.813 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:482.831 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:device-functional-group controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:482.851 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:482.869 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:482.886 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:482.900 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:482.926 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:482.940 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:482.963 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:482.977 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-peer-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.026 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.049 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.063 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.077 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.096 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.108 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.121 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.133 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:_internal_vn_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.155 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.167 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.183 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:_internal_ipam_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.231 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:default-project:_internal_ipam_ipv6_link_local,default-domain:default-project:_internal_vn_ipv6_link_local) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.247 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.262 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.277 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hardware_inventory_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.301 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.315 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:test_overlay_connectivity_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.337 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.351 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:node_profile_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.370 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.383 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.398 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.411 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:check_multicast_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.431 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.445 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.457 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-srx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.474 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-srx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.486 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.498 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.509 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.525 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.538 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:erb-leaf:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.552 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:erb-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.589 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.611 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Leaf-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.630 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.648 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.661 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-mx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.674 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-mx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.686 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.698 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-ebgp-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.717 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.735 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.755 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.769 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.781 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.795 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.808 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.825 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.838 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx240h-poe controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.849 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.860 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.878 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.893 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.904 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.918 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-36q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.929 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.943 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-72q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.957 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.970 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vqfx-10000 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:483.981 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:483.994 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-60c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:484.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:484.029 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:484.052 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:484.070 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:484.086 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:484.102 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:484.117 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:infra-bms-access controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:484.128 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:484.144 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:484.157 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:telemetry controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:484.168 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:484.185 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-client controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:484.197 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:484.216 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:484.228 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:491.240 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:492.825 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:502.025 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 9daf18a3-d98c-4998-a14b-66920f4ab2ad controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:504.981 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:505.153 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:505.197 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:505.222 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-overlay-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:505.247 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:505.265 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Gateway-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:505.307 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:505.888 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 182eed38-a088-41ce-8310-1c4f852a655f controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:505.909 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 182eed38-a088-41ce-8310-1c4f852a655f controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:506.553 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 4ffcf4e5-d53c-406d-827c-f4a48f0700ea controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:507.322 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile d21e436e-e28f-4769-9584-9728f9b6c801 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 01:55:01:507.349 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile d21e436e-e28f-4769-9584-9728f9b6c801 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 01:55:01:507.586 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance e629c448-82cf-44a5-8d46-2670e37dbb61 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:508.201 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.241 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.261 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.297 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.315 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_os_computes_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.340 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.358 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.382 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.398 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.420 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.437 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.459 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.480 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.502 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.522 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:firewall controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.535 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:vn-interconnect controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.574 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.593 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:underlay-ip-clos controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.605 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.620 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.632 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.681 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l2-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.701 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.720 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.737 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:overlay-bgp controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.755 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.789 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-mcast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.804 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.824 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:508.839 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.856 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5120 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:508.882 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:511.196 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48y-8c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:511.226 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:511.248 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48t-6c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:511.260 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:511.275 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-32c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:511.286 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.469 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.516 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:518.555 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.593 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.617 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.647 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.666 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.687 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.704 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:port-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:518.717 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.734 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.765 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.788 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.805 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:518.818 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.838 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.854 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:518.879 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.897 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:518.915 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.934 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.955 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.972 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:518.991 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.006 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.019 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.044 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.069 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.088 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:pnf-servicechain controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.106 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.123 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-32cd controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.136 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.155 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.173 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.209 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.225 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.248 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.266 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.290 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.308 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.329 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.344 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.377 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.396 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.422 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.439 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.457 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:route-reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.469 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.486 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.500 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.517 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.535 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.583 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.623 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.636 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.652 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.667 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.685 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.702 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.720 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.736 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.754 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.771 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.787 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.802 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.817 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx960 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.829 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:role_assignment_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.852 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.879 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dci-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.895 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.912 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.930 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.949 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:519.971 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:519.987 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L2-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.010 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.029 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.044 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.066 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.090 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.109 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx240 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.122 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.136 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.152 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.170 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.190 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.207 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating grpc-profile:default-domain:default-project:grpc-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.226 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.239 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-6 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.257 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.276 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating netconf-profile:default-domain:default-project:netconf-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.289 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.304 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.337 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.354 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.372 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.386 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.402 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.419 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.437 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.459 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.480 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.497 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.512 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.531 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.547 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.577 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.593 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.609 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.626 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.641 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:520.671 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.697 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.719 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.738 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.759 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.776 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.795 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.811 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.831 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.846 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.863 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:520.882 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:524.379 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:525.055 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 18968228-aaec-4c03-8443-b0ef809a5b19 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-20 Mon 01:55:01:525.598 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 666b6320-af65-4250-85a3-ffae7490bd3e controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:525.619 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 666b6320-af65-4250-85a3-ffae7490bd3e controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:529.766 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:530.886 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 9d8ae6b3-04bf-4e2d-9f8d-82f7b68168b7 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:531.015 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance a22df29f-de9c-4ba5-8202-c5cff385575f controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:533.051 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:erb-ucast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.099 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.125 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.160 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.177 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.193 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.215 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.229 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.243 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:ztp_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.271 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.303 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:cli_sync_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.326 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx1500 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.403 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.438 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.458 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Lean-Spine-with-Route-Reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.481 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.506 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.520 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-spine:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.541 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.556 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2650-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.595 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2650-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.609 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.649 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.665 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:533.687 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:533.702 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.323 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.340 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.381 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.396 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.424 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.446 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.473 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.513 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.534 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-access controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.583 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5220 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.617 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.636 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.652 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-128c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.663 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.682 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.697 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5400 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.713 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx10003 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.725 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_role_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.748 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.776 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.800 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.818 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.834 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:534.853 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.876 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.894 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.912 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.928 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.946 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.961 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:534.978 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:535.001 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:535.018 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:535.036 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:535.051 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:535.070 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:535.097 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:535.112 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:535.130 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:535.146 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:535.164 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:535.946 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-5 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:536.004 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:536.025 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating snmp-profile:default-domain:default-project:snmp-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:536.039 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:536.235 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:01:536.312 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:536.470 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:536.601 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:536.667 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:536.694 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:536.749 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:536.781 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:536.839 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:536.862 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:536.891 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:536.973 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.027 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.052 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.110 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.190 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:search_ip_mac_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:537.223 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.281 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:537.307 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5120:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:537.408 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 83709758-e089-442e-8bc2-4932e76c585a controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:537.437 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 83709758-e089-442e-8bc2-4932e76c585a controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 01:55:01:537.440 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.524 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vsrx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:537.558 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5800 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:537.619 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:537.632 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:pnf-service-chaining controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:537.691 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.720 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.774 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Spine-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:537.800 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.863 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.879 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:537.936 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:537.990 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-4 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:538.012 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:538.084 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:538.105 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:538.190 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:538.257 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-3 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:538.275 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:538.338 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-access-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:538.352 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:538.418 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:538.444 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:542.580 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-48s-4c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:542.634 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:542.704 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:542.742 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:542.797 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:542.857 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.034 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.100 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.122 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.161 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.200 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.228 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.253 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.275 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.321 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.349 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.380 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.408 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.434 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.489 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.524 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.550 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-48y controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.581 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.608 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.635 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-aa controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.653 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.687 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.709 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.726 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.756 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.778 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.796 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.817 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-32c-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.838 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.863 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.888 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.913 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.939 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:547.957 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:547.982 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:548.006 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:548.031 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5210-64c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:548.048 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:548.076 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:548.094 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:548.124 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:548.155 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-management-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:548.190 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:552.758 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:552.844 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:552.866 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:552.949 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:552.974 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:552.997 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.021 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.042 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.064 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.082 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.101 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.126 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.144 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.161 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.178 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.200 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.214 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.233 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.248 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-all-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.270 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.296 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.312 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.330 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.383 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.427 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.445 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.469 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.486 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.507 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.611 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4100 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.630 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.685 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.703 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vmx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.745 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-leaf:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.764 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.808 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.892 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.913 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2650-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:553.963 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:553.983 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:554.030 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:554.059 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:554.112 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:554.135 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:554.191 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:554.208 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:554.259 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:554.278 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:559.176 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.237 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_server_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:559.286 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.311 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:559.333 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.372 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_chassis_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:559.404 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.445 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:559.468 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.524 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx480 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:559.594 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.648 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.672 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.711 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.732 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:559.744 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.797 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx204 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:559.814 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.832 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.874 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.892 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2020 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:559.907 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.942 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2010 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:559.955 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:559.973 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.011 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.032 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.054 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.090 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:560.106 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.125 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.162 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:560.183 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.219 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:560.240 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.257 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:560.298 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.324 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.358 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:560.381 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.436 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.453 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:560.497 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.533 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.606 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:560.637 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.679 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.703 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.740 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:560.764 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.809 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.828 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:560.849 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.882 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:560.939 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:560.962 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:server_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:561.007 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.025 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_ops_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:561.091 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.110 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:rma_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:561.153 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.170 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:561.189 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.236 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.256 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.302 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.319 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.356 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.374 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.389 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4200 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:561.419 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.436 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4600 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:561.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.496 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.516 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.557 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.590 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:image_upgrade_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:561.646 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.665 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:existing_fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:561.708 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.727 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:561.745 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.788 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.810 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.849 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:561.866 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:561.909 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:562.059 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:topology_discovery_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:562.089 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.111 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:568.168 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.198 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:568.224 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.244 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_interface_details_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:568.275 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.294 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:568.327 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.352 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.408 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.431 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.452 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.474 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.494 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.517 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.536 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.553 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.587 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.609 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.627 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.650 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.681 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.699 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:568.719 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.737 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:568.757 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.784 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.810 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.830 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.848 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.868 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.885 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.941 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.961 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:568.980 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.027 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.046 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_device_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.075 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.096 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.115 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.133 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-fabric-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.146 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.165 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.179 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.199 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.216 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.232 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.250 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.283 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.301 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.322 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.340 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.356 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.372 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.390 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.408 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.581 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.607 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.633 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.654 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.674 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.692 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.710 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.729 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-pnf-servicechain-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.750 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.770 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.814 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.838 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Storage-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.865 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.885 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.911 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.929 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:container_cleanup_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.953 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:569.968 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:569.984 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.003 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.021 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.038 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.055 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.072 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.130 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.147 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.167 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.189 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.204 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.220 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_deactivate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.244 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.259 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:vcenter_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.281 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.300 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.320 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.337 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5220:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.358 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.381 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.401 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.424 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.439 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.455 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.481 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.498 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.514 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.533 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.585 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.617 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.633 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hitless_upgrade_strategy_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.656 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.673 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2650-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.690 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.705 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.723 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.742 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.760 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-properties:default-global-system-config:config_property controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.778 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-properties controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.793 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.834 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.859 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.887 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.909 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.925 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_mac_mob_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.949 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:570.969 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:570.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.027 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:571.046 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.070 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.086 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:571.103 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.123 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.141 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.158 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.180 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.198 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.216 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.247 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.264 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:571.285 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.304 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.321 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:571.342 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.357 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2650-2:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:571.382 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.405 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.434 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:571.452 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.471 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.495 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.512 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.529 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.546 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.576 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.594 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.612 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.632 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.647 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:571.668 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.760 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 01:55:01:571.785 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.805 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.823 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.847 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.875 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.897 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.919 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.935 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.970 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:571.990 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:572.008 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 01:55:01:590.194 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: EndOfRib point was reached, IF-MAP objects have been created controller/src/dns/main.cc 86 2025-01-20 Mon 01:55:01:590.255 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS.0, counting 0 elements controller/src/dns/main.cc 98 2025-01-20 Mon 01:55:01:590.275 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS_record.0, counting 0 elements controller/src/dns/main.cc 98 2025-01-20 Mon 01:55:01:590.292 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.network_ipam.0, counting 3 elements controller/src/dns/main.cc 98 2025-01-20 Mon 01:55:01:590.308 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_network_network_ipam.0, counting 1 elements controller/src/dns/main.cc 98 2025-01-20 Mon 01:55:01:590.324 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.global_qos_config.0, counting 1 elements controller/src/dns/main.cc 98 2025-01-20 Mon 01:55:01:590.339 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: VnniConfig has been updated after the bulk sync, the number of elements: 1 controller/src/dns/main.cc 109 2025-01-20 Mon 01:55:01:590.354 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: IpamConfig has been updated after the bulk sync, the number of elements: 3 controller/src/dns/main.cc 120 2025-01-20 Mon 01:55:01:590.368 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 131 2025-01-20 Mon 01:55:01:590.382 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsRecordConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 142 2025-01-20 Mon 01:55:01:590.396 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: GlobalQosConfig has been updated after the bulk sync controller/src/dns/main.cc 152 2025-01-20 Mon 01:55:01:590.497 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-01-20 Mon 01:55:01:590.516 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-01-20 Mon 01:55:01:590.667 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:55:01:590.745 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: SANDESH: Send FAILED: 1737338101590462 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-01-20 Mon 01:55:01:590.759 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:55:01:677.047 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-01-20 Mon 01:55:01:680.121 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.49:50634::10.0.0.42:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-01-20 Mon 01:55:01:680.166 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: 10.0.0.49:50634::10.0.0.42:8086(-1) OnSessionEvent TCP Connected 2025-01-20 Mon 01:55:01:680.184 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: 10.0.0.49:50634::10.0.0.42:8086(-1):EvTcpConnected 2025-01-20 Mon 01:55:01:680.515 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named up; DNS is operational controller/src/dns/mgr/dns_mgr.cc 737 2025-01-20 Mon 01:55:01:680.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Processing scm::EvSandeshSend in state Connect 2025-01-20 Mon 01:55:01:680.608 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: SANDESH: Send FAILED: 1737338101677007 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:55:01:680.635 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-20 Mon 01:55:01:680.652 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Processing scm::EvTcpConnected in state Connect 2025-01-20 Mon 01:55:01:680.663 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-20 Mon 01:55:01:680.712 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ClientInit 2025-01-20 Mon 01:55:01:680.733 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2650-3:contrail-dns:0:Control count 1 2025-01-20 Mon 01:55:01:680.966 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 225 2025-01-20 Mon 01:55:01:681.109 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:55:01:681.124 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-20 Mon 01:55:01:681.151 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: SANDESH: Send FAILED: 1737338101680701 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-20 Mon 01:55:01:681.160 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Received UVE message in wrong state : NodeStatusUVE 2025-01-20 Mon 01:55:01:681.169 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:55:01:681.176 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-20 Mon 01:55:01:681.190 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Processing scm::EvSandeshSend in state ClientInit 2025-01-20 Mon 01:55:01:681.197 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-20 Mon 01:55:01:681.453 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: SANDESH: Send FAILED: 1737338101681089 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 106128 http_port = 8092 start_time = 1737338100474503 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 921, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-20 Mon 01:55:01:681.482 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-20 Mon 01:55:01:684.188 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: OnMessage control in state: ClientInit 2025-01-20 Mon 01:55:01:684.241 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-01-20 Mon 01:55:01:684.251 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ClientInit : EvSandeshMessageRecv 2025-01-20 Mon 01:55:01:684.276 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: Received Ctrl Message with size 0 2025-01-20 Mon 01:55:01:684.287 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:55:01:684.487 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2650-3:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 106128 http_port = 8092 start_time = 1737338100474503 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.49:8086, (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 921, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] proxy seq 5 2025-01-20 Mon 01:55:01:684.517 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 01:55:01:684.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2650-3 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.22:9041, (*_iter6) = 10.0.0.49:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.22:5673, (*_iter6) = 10.0.0.49:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 8 2025-01-20 Mon 01:55:01:684.575 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-01-20 Mon 01:55:01:684.591 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:55:01:684.599 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:55:01:684.608 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-20 Mon 01:55:01:684.640 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: Established 2025-01-20 Mon 01:55:02:739.845 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: Applying named configuration failed 2025-01-20 Mon 01:55:02:739.947 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been done (the DB has been synced with named) controller/src/dns/mgr/dns_mgr.cc 455 2025-01-20 Mon 01:55:03:070.695 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 01:55:31:986.215 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.42:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-01-20 Mon 01:55:31:991.933 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-01-20 Mon 01:55:31:991.975 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-01-20 Mon 01:55:32:000.635 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.42:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-01-20 Mon 01:55:32:062.876 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-01-20 Mon 01:56:59:659.081 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:37250 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 01:57:00:947.897 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:56202 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 01:57:01:101.493 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:41212 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 01:57:11:146.140 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.22:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-01-20 Mon 01:57:11:163.979 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-01-20 Mon 01:57:11:164.027 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-01-20 Mon 01:57:11:164.548 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.22:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-01-20 Mon 01:57:11:461.549 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-01-20 Mon 01:57:25:895.250 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:50854 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 01:57:26:027.897 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:54652 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 01:57:27:170.088 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:33208 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 01:58:45:495.165 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.49:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-01-20 Mon 01:58:45:496.488 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-01-20 Mon 01:58:45:496.515 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-01-20 Mon 01:58:45:496.711 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.49:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-01-20 Mon 01:58:45:837.482 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139622877230848, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-01-20 Mon 02:01:59:665.097 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:57018 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:02:00:954.156 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:55164 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:02:01:103.505 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:33490 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:02:25:899.136 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:49118 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:02:26:031.758 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:37216 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:02:27:171.299 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:40020 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:06:59:665.746 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:59428 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:07:00:965.550 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:49652 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:07:01:104.839 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:54686 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:07:25:900.077 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:54686 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:07:26:032.234 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:45756 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:07:27:177.519 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:56842 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:11:59:670.426 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:58450 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:12:00:958.647 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:54632 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:12:01:107.488 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:56696 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:12:25:901.576 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:43336 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:12:26:033.154 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:56056 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:12:27:181.732 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:38312 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:14:39:261.526 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:14:39:497.375 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:15:30:549.783 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:15:30:807.691 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:16:59:676.463 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:59062 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:17:00:966.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:40402 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:17:01:113.669 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:59188 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:17:25:907.045 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.18:41978 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:17:26:036.105 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.11:39218 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:17:27:180.335 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.18:8092::10.20.0.7:36846 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:17:32:013.545 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:32:013.798 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:admin controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:32:013.846 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:32:090.780 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:32:091.017 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:admin:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:32:091.100 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:32:154.873 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:32:155.085 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:32:356.517 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:32:356.766 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:admin:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:32:356.809 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:32:500.467 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:32:563.758 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:32:563.980 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:32:564.044 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:32:688.266 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:32:688.485 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:32:688.537 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:33:948.568 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623693944960, Pid 106128]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.49:8092::10.0.0.42:58328 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-20 Mon 02:17:36:077.257 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:36:077.461 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-AnalyticsBasicTestSanity-78205111 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:36:077.513 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:36:159.349 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:36:159.506 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:36:159.548 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:36:232.149 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:36:232.316 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:36:361.726 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:36:361.940 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:36:361.983 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:36:457.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:36:457.191 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:36:457.248 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:36:506.770 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:36:575.599 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:36:575.889 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:36:575.940 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:39:285.157 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:39:796.408 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:39:892.614 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:39:892.848 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-78205111:ctest-vn22-05159446 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:39:893.337 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:39:970.286 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:40:044.797 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:40:111.748 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:40:111.869 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance b0f52465-8996-426f-a808-4e9798a142ea controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:17:40:303.683 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:40:303.889 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-78205111:ctest-vn22-05159446,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:40:303.915 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:40:303.936 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:40:369.279 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:41:083.853 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:41:447.443 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:45:500.327 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:47:695.661 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:47:760.568 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:47:762.181 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:81087c6f-d654-49de-8bdd-eca4975409d4 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:47:896.636 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:47:896.914 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-78205111:6e909866-2ac8-4511-b287-3088f7a7bdeb controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:47:896.984 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:47:897.016 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:47:897.053 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:47:897.077 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:47:958.591 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:48:103.934 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:48:104.175 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:12ff27bb-d12f-4ab2-be9e-72bbdc81a8d0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:17:48:104.252 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:48:104.296 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:17:48:855.147 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:17:48:919.117 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:03:108.926 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:03:108.997 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:03:109.011 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:12ff27bb-d12f-4ab2-be9e-72bbdc81a8d0 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:03:109.037 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:12ff27bb-d12f-4ab2-be9e-72bbdc81a8d0 - virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-78205111:6e909866-2ac8-4511-b287-3088f7a7bdeb , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:03:109.062 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:12ff27bb-d12f-4ab2-be9e-72bbdc81a8d0 - virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-78205111:ctest-vn22-05159446 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:03:195.000 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:03:267.810 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:03:267.878 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:03:267.902 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:03:267.923 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:03:267.936 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-78205111:6e909866-2ac8-4511-b287-3088f7a7bdeb controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:03:267.959 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-78205111:6e909866-2ac8-4511-b287-3088f7a7bdeb - project:default-domain:ctest-AnalyticsBasicTestSanity-78205111 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:03:267.982 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-78205111:6e909866-2ac8-4511-b287-3088f7a7bdeb - security-group:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:03:268.005 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-78205111:6e909866-2ac8-4511-b287-3088f7a7bdeb - virtual-machine:81087c6f-d654-49de-8bdd-eca4975409d4 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:03:268.023 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-78205111:6e909866-2ac8-4511-b287-3088f7a7bdeb - virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-78205111:ctest-vn22-05159446 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:03:347.330 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:81087c6f-d654-49de-8bdd-eca4975409d4 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:04:535.085 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:04:535.149 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:04:535.168 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:04:535.181 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-78205111:ctest-vn22-05159446 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:04:535.192 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-78205111:ctest-vn22-05159446,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:04:535.216 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-78205111:ctest-vn22-05159446 - project:default-domain:ctest-AnalyticsBasicTestSanity-78205111 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:04:535.240 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-78205111:ctest-vn22-05159446 - virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-78205111:ctest-vn22-05159446,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:04:535.257 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-78205111:ctest-vn22-05159446,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:04:619.704 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance b0f52465-8996-426f-a808-4e9798a142ea controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:18:04:880.175 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:05:807.295 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:05:889.067 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:06:047.032 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:06:140.739 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:07:569.940 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:07:570.126 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-FloatingipBasicTestSanity-53644544 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:07:570.196 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:07:678.923 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:07:679.130 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-FloatingipBasicTestSanity-53644544:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:07:679.197 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:07:762.039 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:07:762.239 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:07:943.343 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:07:943.564 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-FloatingipBasicTestSanity-53644544:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:07:943.620 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:08:029.294 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:08:029.531 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-FloatingipBasicTestSanity-53644544:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:08:029.608 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:08:083.784 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:08:187.890 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:08:188.108 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-FloatingipBasicTestSanity-53644544:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:08:188.174 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:09:967.073 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:10:968.015 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:11:196.436 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:11:254.570 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:11:323.401 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:12:452.910 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:12:696.356 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:12:804.519 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:12:804.788 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:12:804.860 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:12:895.973 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:12:995.505 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:13:047.653 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:13:047.775 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance bfbd0b3a-ac52-44db-a401-7c1c4b1421af controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:18:13:181.343 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:13:181.604 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:13:181.644 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:13:181.671 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:13:240.331 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:13:950.993 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:14:393.568 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:15:769.730 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:15:960.908 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:16:071.456 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:16:071.707 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:16:071.775 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:16:162.110 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:16:260.268 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:16:303.079 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:16:303.211 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 715fcbdf-3d49-4318-982f-866c88265060 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:18:16:411.515 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:16:411.747 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:16:411.777 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:16:411.798 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:16:487.835 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:16:826.800 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:17:215.458 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:18:502.735 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:19:505.453 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:19:570.821 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:19:570.961 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:a586f188-0ea7-4e31-9913-ae1f524b3032 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:19:719.212 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:19:719.413 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:7ff2c356-09bc-457f-b2c1-b6fdd2da8c9e controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:19:719.458 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:19:719.488 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:19:719.509 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:19:719.530 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:19:818.487 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:19:962.041 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:19:962.300 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:5d4f741b-41a5-4e53-8fc4-a81daed858e3 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:19:962.377 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:19:962.407 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:20:003.500 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:20:308.084 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:20:375.709 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:20:671.559 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:20:850.681 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:20:850.846 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916:ctest-some-pool-61646292 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:20:850.887 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:20:925.977 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:20:926.175 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:21:147.228 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:21:362.332 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:21:883.332 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:21:996.093 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:21:996.297 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:fb948169-b1ec-4650-8b9a-f2dd4cac23c7 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:22:163.742 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:22:164.021 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:4ac5e18a-ac55-4e2f-aae1-038747c09aa0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:22:164.082 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:22:164.123 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:22:164.164 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:22:164.196 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:22:224.838 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:22:353.824 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:22:354.062 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:cac6dab8-590d-4e46-aaa8-d75b64aaca9b controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:22:354.134 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:22:354.173 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:23:020.125 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:23:081.290 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:38:049.409 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:38:151.251 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:38:151.465 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916:ctest-some-pool-61646292:67c48aaf-dc27-4883-bd65-54fc13e103a9 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:38:151.509 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-pool-floating-ip controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:38:151.539 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:38:329.334 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:38:329.528 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:43:683.280 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:43:683.530 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:43:683.607 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916:ctest-some-pool-61646292:67c48aaf-dc27-4883-bd65-54fc13e103a9 - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:7ff2c356-09bc-457f-b2c1-b6fdd2da8c9e , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:43:788.327 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:43:788.406 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:43:788.446 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting floating-ip:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916:ctest-some-pool-61646292:67c48aaf-dc27-4883-bd65-54fc13e103a9 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:43:788.481 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916:ctest-some-pool-61646292:67c48aaf-dc27-4883-bd65-54fc13e103a9 - floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916:ctest-some-pool-61646292 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:43:788.520 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916:ctest-some-pool-61646292:67c48aaf-dc27-4883-bd65-54fc13e103a9 - project:default-domain:ctest-FloatingipBasicTestSanity-53644544 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:43:880.564 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:43:880.755 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:43:880.791 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-FloatingipBasicTestSanity-53644544 - floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916:ctest-some-pool-61646292 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:43:935.542 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:43:935.596 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916:ctest-some-pool-61646292 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:43:935.633 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916:ctest-some-pool-61646292 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:44:769.920 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:44:769.994 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:44:770.023 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:cac6dab8-590d-4e46-aaa8-d75b64aaca9b controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:44:770.055 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:cac6dab8-590d-4e46-aaa8-d75b64aaca9b - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:4ac5e18a-ac55-4e2f-aae1-038747c09aa0 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:44:770.087 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:cac6dab8-590d-4e46-aaa8-d75b64aaca9b - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:44:902.071 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:44:991.127 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:44:991.181 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:44:991.195 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:5d4f741b-41a5-4e53-8fc4-a81daed858e3 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:44:991.219 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:5d4f741b-41a5-4e53-8fc4-a81daed858e3 - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:7ff2c356-09bc-457f-b2c1-b6fdd2da8c9e , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:44:991.244 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:5d4f741b-41a5-4e53-8fc4-a81daed858e3 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:45:029.380 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:45:029.445 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:45:029.494 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:45:029.514 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:45:029.527 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:4ac5e18a-ac55-4e2f-aae1-038747c09aa0 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:45:029.549 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:4ac5e18a-ac55-4e2f-aae1-038747c09aa0 - project:default-domain:ctest-FloatingipBasicTestSanity-53644544 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:45:029.598 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:4ac5e18a-ac55-4e2f-aae1-038747c09aa0 - security-group:default-domain:ctest-FloatingipBasicTestSanity-53644544:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:45:029.619 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:4ac5e18a-ac55-4e2f-aae1-038747c09aa0 - virtual-machine:fb948169-b1ec-4650-8b9a-f2dd4cac23c7 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:45:029.704 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:4ac5e18a-ac55-4e2f-aae1-038747c09aa0 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:45:097.349 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:fb948169-b1ec-4650-8b9a-f2dd4cac23c7 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:45:135.083 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:45:227.816 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:45:227.877 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:45:227.909 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:45:227.931 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:45:227.943 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:7ff2c356-09bc-457f-b2c1-b6fdd2da8c9e controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:45:227.968 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:7ff2c356-09bc-457f-b2c1-b6fdd2da8c9e - project:default-domain:ctest-FloatingipBasicTestSanity-53644544 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:45:227.990 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:7ff2c356-09bc-457f-b2c1-b6fdd2da8c9e - security-group:default-domain:ctest-FloatingipBasicTestSanity-53644544:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:45:228.007 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:7ff2c356-09bc-457f-b2c1-b6fdd2da8c9e - virtual-machine:a586f188-0ea7-4e31-9913-ae1f524b3032 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:45:228.022 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-53644544:7ff2c356-09bc-457f-b2c1-b6fdd2da8c9e - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:45:286.291 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:a586f188-0ea7-4e31-9913-ae1f524b3032 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:46:348.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:46:348.445 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:46:348.494 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:46:348.515 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:46:348.532 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:46:348.595 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 - project:default-domain:ctest-FloatingipBasicTestSanity-53644544 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:46:348.633 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 - virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:46:348.662 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:46:424.497 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 715fcbdf-3d49-4318-982f-866c88265060 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:18:46:657.572 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:46:874.636 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:46:874.697 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:46:874.714 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:46:874.736 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:46:874.747 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:46:874.771 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 - project:default-domain:ctest-FloatingipBasicTestSanity-53644544 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:46:874.793 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 - virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:46:874.810 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:46:938.072 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance bfbd0b3a-ac52-44db-a401-7c1c4b1421af controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:18:47:140.991 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:48:608.048 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:48:686.532 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:48:821.247 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:48:936.176 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:50:163.868 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:50:164.024 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-TestHeat-71270079 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:50:164.064 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:50:221.719 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:50:221.870 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-TestHeat-71270079:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:50:221.923 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:50:283.173 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:50:283.345 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:50:464.638 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:50:464.847 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-TestHeat-71270079:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:50:464.887 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:50:546.992 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:50:547.259 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestHeat-71270079:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:50:547.331 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:50:616.165 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:50:679.786 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:50:679.968 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestHeat-71270079:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:50:680.016 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:55:209.326 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:55:299.064 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:55:412.688 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:55:503.545 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:56:519.717 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:56:520.941 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:56:536.204 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:56:684.791 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:56:725.911 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:56:767.336 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:56:874.946 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:56:875.019 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove security-group:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default - project:default-domain:ctest-AnalyticsBasicTestSanity-78205111 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:56:894.115 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:56:894.166 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove security-group:default-domain:ctest-TestHeat-71270079:default - project:default-domain:ctest-TestHeat-71270079 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:56:894.266 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:56:972.137 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:005.218 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:005.283 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove security-group:default-domain:ctest-FloatingipBasicTestSanity-53644544:default - project:default-domain:ctest-FloatingipBasicTestSanity-53644544 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:068.714 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:068.751 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:068.778 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default:ingress-access-control-list - security-group:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:109.117 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:136.914 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:201.148 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:244.069 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:302.394 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:331.742 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:331.782 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:331.796 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting security-group:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:331.820 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default:egress-access-control-list - security-group:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:384.434 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:391.904 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:430.417 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:430.560 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-TestRoutersBasic-14108397 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:57:430.615 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:57:467.646 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:467.814 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:467.859 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-AnalyticsBasicTestSanity-78205111 - application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default-application-policy-set , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:505.120 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:505.293 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:505.329 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-TestHeat-71270079 - application-policy-set:default-domain:ctest-TestHeat-71270079:default-application-policy-set , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:522.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:561.544 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:561.606 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-TestHeat-71270079:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:561.643 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-TestHeat-71270079:default:ingress-access-control-list - security-group:default-domain:ctest-TestHeat-71270079:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:589.736 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:589.898 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-TestRoutersBasic-14108397:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:57:589.941 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:57:601.340 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:601.422 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:601.450 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-78205111:default-application-policy-set - project:default-domain:ctest-AnalyticsBasicTestSanity-78205111 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:638.607 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:638.784 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:638.818 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-FloatingipBasicTestSanity-53644544 - application-policy-set:default-domain:ctest-FloatingipBasicTestSanity-53644544:default-application-policy-set , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:677.657 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:677.697 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting application-policy-set:default-domain:ctest-TestHeat-71270079:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:677.722 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove application-policy-set:default-domain:ctest-TestHeat-71270079:default-application-policy-set - project:default-domain:ctest-TestHeat-71270079 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:699.371 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:699.413 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting project:default-domain:ctest-AnalyticsBasicTestSanity-78205111 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:699.438 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-AnalyticsBasicTestSanity-78205111 - domain:default-domain , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:737.035 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:737.219 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:57:740.332 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:740.352 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-TestHeat-71270079:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:740.366 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting security-group:default-domain:ctest-TestHeat-71270079:default controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:740.385 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-TestHeat-71270079:default:egress-access-control-list - security-group:default-domain:ctest-TestHeat-71270079:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:832.486 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:832.525 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting application-policy-set:default-domain:ctest-FloatingipBasicTestSanity-53644544:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:832.547 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove application-policy-set:default-domain:ctest-FloatingipBasicTestSanity-53644544:default-application-policy-set - project:default-domain:ctest-FloatingipBasicTestSanity-53644544 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:860.096 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:860.134 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting project:default-domain:ctest-TestHeat-71270079 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:860.158 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-TestHeat-71270079 - domain:default-domain , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:877.546 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:877.606 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-FloatingipBasicTestSanity-53644544:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:877.632 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-FloatingipBasicTestSanity-53644544:default:ingress-access-control-list - security-group:default-domain:ctest-FloatingipBasicTestSanity-53644544:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:906.810 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:906.855 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting project:default-domain:ctest-FloatingipBasicTestSanity-53644544 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:906.899 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-FloatingipBasicTestSanity-53644544 - domain:default-domain , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:57:951.527 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:57:951.755 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-TestRoutersBasic-14108397:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:57:951.798 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:57:951.902 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:18:57:951.918 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-FloatingipBasicTestSanity-53644544:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:951.929 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting security-group:default-domain:ctest-FloatingipBasicTestSanity-53644544:default controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:18:57:951.949 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-FloatingipBasicTestSanity-53644544:default:egress-access-control-list - security-group:default-domain:ctest-FloatingipBasicTestSanity-53644544:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:18:58:105.511 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:58:105.717 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestRoutersBasic-14108397:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:58:105.760 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:18:58:120.434 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:58:218.795 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:18:58:218.983 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestRoutersBasic-14108397:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:18:58:219.040 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:02:269.369 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:02:453.747 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:02:666.207 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:02:715.990 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:02:757.747 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:02:889.149 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:03:126.000 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:03:208.288 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:03:208.512 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:03:208.559 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:03:275.890 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:03:331.825 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:03:387.232 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:03:387.352 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance e202be65-cd03-4662-ba06-5f19801a6a79 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:03:525.599 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:03:525.860 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:03:525.921 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:03:525.943 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:03:576.253 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:03:823.351 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:03:978.412 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:04:061.245 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:04:061.442 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:04:061.490 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:04:136.117 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:04:207.438 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:04:207.633 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip-pool:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925:floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:04:207.684 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:04:216.158 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:04:279.064 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:04:279.178 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 7543ad10-42ef-43da-8785-81162f6edc94 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:04:406.126 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:04:406.329 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:04:406.359 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:04:406.379 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:04:458.107 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:05:783.676 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:06:730.290 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:06:778.576 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:06:778.732 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:b8633236-f17e-4eda-bdfc-b9362914289f controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:06:888.058 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:06:888.277 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:12583078-c3b6-43ff-9176-d0db77540735 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:06:888.322 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:06:888.355 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:06:888.377 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:06:888.398 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:06:948.299 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:07:081.350 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:07:081.566 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:728d49e5-a9e0-42bc-8f86-0ad68c3d4e6b controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:07:081.661 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:07:081.712 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:07:335.820 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:07:404.334 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:07:452.532 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:07:920.448 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:07:997.840 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:07:997.995 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating logical-router:default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:07:998.064 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-logical-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:063.433 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:130.281 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:130.466 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating logical-router-virtual-network:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925,default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:08:130.492 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:130.527 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:146.351 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:312.717 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:447.779 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:448.026 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:1fa2ccca-2ed5-4735-865f-dc7cc2ecfb48 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:08:448.089 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:448.133 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:493.971 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:494.176 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:08:494.224 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:494.252 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:08:494.270 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:494.288 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:541.878 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:629.367 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:657.644 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:689.609 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:689.784 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:84c0a579-7f44-4106-8361-6f2ded0ba367 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:08:689.840 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:689.868 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:719.852 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:719.988 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:66ec1626-156a-4ebc-821d-500291614935 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:08:739.959 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:792.114 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:805.157 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:805.351 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-instance:default-domain:ctest-TestRoutersBasic-14108397:snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:08:805.394 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:805.423 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating service-instance-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:832.501 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:832.639 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0f9cf945-5b15-4df5-89d3-6856e93b9c1f controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:08:913.837 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:914.013 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:948.914 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:949.103 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-table:default-domain:ctest-TestRoutersBasic-14108397:rt_fcf145fc-7448-4efe-be87-c90391a7b7bc controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:08:949.151 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-route-table controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:972.877 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:08:973.198 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:d5be54ca-c7d6-4c81-8981-f119e80d55a4 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:08:973.266 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:973.318 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:973.356 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:08:973.389 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:09:053.491 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:09:053.699 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:09:058.207 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:09:058.320 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance e202be65-cd03-4662-ba06-5f19801a6a79 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:09:092.716 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:09:267.096 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:09:267.303 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-route-table controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:09:357.857 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:09:358.043 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:93ca78f3-bf71-4aac-9f87-93b81ab3cc44 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:09:358.084 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:09:358.111 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:09:497.437 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:09:497.663 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:09:497.710 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:09:702.709 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:09:703.033 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__right__1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:09:703.104 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:09:703.151 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:09:703.188 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:09:703.221 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:09:775.517 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:09:813.569 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:09:875.934 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:09:892.150 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:026.724 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:026.929 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043-right controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:10:026.993 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:10:137.659 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:205.427 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:265.544 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:354.054 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:354.240 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:10:493.485 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:493.746 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__left__2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:10:493.808 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:10:493.845 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:10:493.871 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:10:493.895 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:10:556.361 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:616.833 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:733.080 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:733.276 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043-left controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:10:733.335 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:10:826.337 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:878.647 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:943.884 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:990.700 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:10:990.936 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:055.175 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:055.479 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:061.819 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:061.975 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0f9cf945-5b15-4df5-89d3-6856e93b9c1f controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:11:123.481 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:170.220 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:170.409 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:11:170.464 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:280.383 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:280.653 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__right__1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:11:280.715 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:280.766 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:280.804 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:280.839 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:354.595 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:413.773 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:488.605 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:536.503 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:596.543 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:655.549 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:694.624 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:694.816 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:811.515 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:811.759 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__left__2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:11:811.836 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:811.871 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:811.899 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:811.925 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:11:849.245 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:896.675 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:11:972.515 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:12:032.952 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:12:105.360 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:12:144.138 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:12:193.843 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:12:194.034 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:12:240.292 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:12:240.481 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:31:980.683 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:31:985.022 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:31:985.110 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router:default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829 - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:1fa2ccca-2ed5-4735-865f-dc7cc2ecfb48 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:047.132 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:32:047.279 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance e202be65-cd03-4662-ba06-5f19801a6a79 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:32:094.800 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:094.860 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:094.874 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:84c0a579-7f44-4106-8361-6f2ded0ba367 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:32:094.898 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:84c0a579-7f44-4106-8361-6f2ded0ba367 - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:1fa2ccca-2ed5-4735-865f-dc7cc2ecfb48 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:094.924 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:84c0a579-7f44-4106-8361-6f2ded0ba367 - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:168.111 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:168.180 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:168.195 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:1fa2ccca-2ed5-4735-865f-dc7cc2ecfb48 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:32:168.220 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:1fa2ccca-2ed5-4735-865f-dc7cc2ecfb48 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:168.243 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:1fa2ccca-2ed5-4735-865f-dc7cc2ecfb48 - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:307.355 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:32:307.576 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:307.627 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:307.648 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting logical-router-virtual-network:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925,default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:32:307.685 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router:default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829 - logical-router-virtual-network:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925,default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:307.714 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router-virtual-network:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925,default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829) - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:405.234 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:405.291 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:405.318 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:405.338 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting logical-router:default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:32:405.362 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router:default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:405.395 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router:default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829 - route-table:default-domain:ctest-TestRoutersBasic-14108397:rt_fcf145fc-7448-4efe-be87-c90391a7b7bc , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:405.414 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove logical-router:default-domain:ctest-TestRoutersBasic-14108397:ctest-router1-40651829 - service-instance:default-domain:ctest-TestRoutersBasic-14108397:snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:489.263 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:489.310 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting route-table:default-domain:ctest-TestRoutersBasic-14108397:rt_fcf145fc-7448-4efe-be87-c90391a7b7bc controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:32:489.335 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove route-table:default-domain:ctest-TestRoutersBasic-14108397:rt_fcf145fc-7448-4efe-be87-c90391a7b7bc - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:512.512 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:32:512.690 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0f9cf945-5b15-4df5-89d3-6856e93b9c1f controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:32:551.977 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:32:591.539 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:32:591.744 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:591.798 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__left__2 - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:669.715 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:32:669.948 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:670.009 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__left__2 - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:748.859 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:748.930 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:748.955 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:748.968 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043-left controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:32:748.993 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043-left - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__left__2 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:749.028 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043-left - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__left__2 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:749.046 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043-left - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:857.985 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:858.072 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:858.106 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:858.129 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:32:858.150 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:32:858.187 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:858.240 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 - virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:858.271 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:snat-si-left_snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:858.833 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:32:858.868 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting floating-ip-pool:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925:floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:32:858.896 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip-pool:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925:floating-ip-pool - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:32:963.222 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:33:000.092 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:33:091.328 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0f9cf945-5b15-4df5-89d3-6856e93b9c1f controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:33:210.872 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:210.940 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:210.977 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove service-instance:default-domain:ctest-TestRoutersBasic-14108397:snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:211.007 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove service-instance:default-domain:ctest-TestRoutersBasic-14108397:snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 - service-template:default-domain:netns-snat-template , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:380.138 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:380.199 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:380.227 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:380.245 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__left__2 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:33:380.269 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__left__2 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:380.294 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__left__2 - security-group:default-domain:ctest-TestRoutersBasic-14108397:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:380.313 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__left__2 - virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:418.418 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:418.493 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:418.507 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:93ca78f3-bf71-4aac-9f87-93b81ab3cc44 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:33:418.541 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:93ca78f3-bf71-4aac-9f87-93b81ab3cc44 - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:d5be54ca-c7d6-4c81-8981-f119e80d55a4 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:418.565 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:93ca78f3-bf71-4aac-9f87-93b81ab3cc44 - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:483.555 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:33:483.862 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:483.919 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043-right - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__right__1 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:503.600 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:33:584.400 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:584.475 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:584.503 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:584.523 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:584.537 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:d5be54ca-c7d6-4c81-8981-f119e80d55a4 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:33:584.560 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:d5be54ca-c7d6-4c81-8981-f119e80d55a4 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:584.598 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:d5be54ca-c7d6-4c81-8981-f119e80d55a4 - security-group:default-domain:ctest-TestRoutersBasic-14108397:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:584.617 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:d5be54ca-c7d6-4c81-8981-f119e80d55a4 - virtual-machine:66ec1626-156a-4ebc-821d-500291614935 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:584.634 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:d5be54ca-c7d6-4c81-8981-f119e80d55a4 - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:624.747 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:624.809 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:624.845 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:624.867 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:624.881 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__right__1 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:33:624.924 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__right__1 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:624.961 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__right__1 - security-group:default-domain:ctest-TestRoutersBasic-14108397:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:624.980 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__right__1 - virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:624.998 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2__right__1 - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:679.233 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:66ec1626-156a-4ebc-821d-500291614935 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:33:717.063 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:33:717.265 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:717.320 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2650-1 - virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:753.672 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:753.725 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:753.739 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:728d49e5-a9e0-42bc-8f86-0ad68c3d4e6b controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:33:753.765 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:728d49e5-a9e0-42bc-8f86-0ad68c3d4e6b - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:12583078-c3b6-43ff-9176-d0db77540735 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:753.790 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:728d49e5-a9e0-42bc-8f86-0ad68c3d4e6b - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:759.794 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:759.838 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:33:759.866 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__2 - service-instance:default-domain:ctest-TestRoutersBasic-14108397:snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:839.487 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:33:839.695 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:839.733 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043-right - virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__right__1 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:881.503 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:33:927.670 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:927.724 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043-right controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:33:927.756 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043-right - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:964.098 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:964.159 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:964.183 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:964.215 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:33:964.228 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:12583078-c3b6-43ff-9176-d0db77540735 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:33:964.253 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:12583078-c3b6-43ff-9176-d0db77540735 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:964.278 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:12583078-c3b6-43ff-9176-d0db77540735 - security-group:default-domain:ctest-TestRoutersBasic-14108397:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:964.296 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:12583078-c3b6-43ff-9176-d0db77540735 - virtual-machine:b8633236-f17e-4eda-bdfc-b9362914289f , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:33:964.316 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:12583078-c3b6-43ff-9176-d0db77540735 - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:34:022.613 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:b8633236-f17e-4eda-bdfc-b9362914289f controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:34:089.371 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:34:089.447 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:34:089.476 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:34:089.513 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:34:089.531 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__right__1 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:34:089.567 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__right__1 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:34:089.618 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__right__1 - security-group:default-domain:ctest-TestRoutersBasic-14108397:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:34:089.649 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__right__1 - virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:34:089.670 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__right__1 - virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:34:200.779 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:34:200.864 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:34:205.631 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:34:205.661 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__left__2 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:34:205.695 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__left__2 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:34:205.781 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__left__2 - security-group:default-domain:ctest-TestRoutersBasic-14108397:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:34:205.814 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-TestRoutersBasic-14108397:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1__left__2 - virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:34:265.468 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:34:265.662 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:34:265.698 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2650-2 - virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:34:318.150 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:34:318.199 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:34:318.211 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting service-instance:default-domain:ctest-TestRoutersBasic-14108397:snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:34:318.238 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine:default-domain__ctest-TestRoutersBasic-14108397__snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043__1 - service-instance:default-domain:ctest-TestRoutersBasic-14108397:snat_fcf145fc-7448-4efe-be87-c90391a7b7bc_eef367a7-443d-4c6a-be0a-518d5b9b1043 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:35:006.376 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:35:006.454 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:35:006.480 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:35:006.498 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:35:006.515 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:35:006.564 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:35:006.631 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925 - virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:35:006.658 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-ext_vn-62634925,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:35:093.858 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 7543ad10-42ef-43da-8785-81162f6edc94 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:35:281.412 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:35:281.472 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:35:281.490 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:35:281.503 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:35:281.515 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:35:281.539 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393 - project:default-domain:ctest-TestRoutersBasic-14108397 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:35:281.562 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393 - virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:35:281.593 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-14108397:ctest-vn-44164393,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:35:356.787 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance e202be65-cd03-4662-ba06-5f19801a6a79 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:36:740.794 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:36:819.414 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:36:919.535 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:37:033.411 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:38:214.537 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:38:214.699 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-TestBasicPolicyIpv4v6-00453742 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:38:214.739 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:38:278.128 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:38:278.279 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:38:278.319 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:38:339.144 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:38:339.385 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:38:508.856 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:38:509.115 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:38:509.158 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:38:579.185 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:38:579.372 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:38:579.422 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:38:653.227 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:38:653.466 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:38:653.531 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:38:709.720 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:42:178.227 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:42:409.162 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:42:496.458 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:42:496.651 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-83465661 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:42:496.706 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:42:573.456 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:42:791.884 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:42:792.072 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-83465661,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:42:792.101 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:42:792.123 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:42:851.116 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:43:075.564 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:43:115.031 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:43:115.150 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance f606817b-30f8-4745-aaa6-9229f59ca04c controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:43:144.341 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:43:222.408 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:43:566.681 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:43:763.424 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:43:851.071 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:43:851.327 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:43:851.399 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623527483136, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:43:914.551 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:43:980.671 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:44:037.470 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:44:037.610 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance bd34dc61-21dc-4d4c-b7b5-747b188a960e controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:44:129.856 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:44:130.088 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:44:130.133 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:44:130.158 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:44:192.522 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:44:436.697 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:44:495.153 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:44:850.015 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:44:989.557 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:44:989.790 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-policy:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-policy-allow-all-28987689 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:44:989.837 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-policy controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:45:116.842 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:45:117.118 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-policy:attr(default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-policy-allow-all-28987689,default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-83465661) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:45:117.162 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-policy controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:45:117.199 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-policy controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:45:182.035 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:45:315.920 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623497959168, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:45:316.209 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-83465661:ctest-vn-83465661 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:45:316.297 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:45:425.457 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:45:425.648 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-policy:attr(default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-policy-allow-all-28987689,default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:45:425.678 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-policy controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:45:425.714 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-policy controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:45:528.981 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:45:549.453 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623502157568, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:45:675.617 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:45:675.888 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981:ctest-vn-61278981 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-20 Mon 02:19:45:675.939 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-20 Mon 02:19:45:744.824 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:45:745.000 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623506491136, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: connection No entry in metadata map routing_instance bd34dc61-21dc-4d4c-b7b5-747b188a960e controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:45:768.050 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:45:768.184 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623514887936, Pid 106128]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: connection No entry in metadata map routing_instance f606817b-30f8-4745-aaa6-9229f59ca04c controller/src/ifmap/client/config_json_parser.cc 223 2025-01-20 Mon 02:19:46:206.295 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623510689536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:46:573.445 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:47:953.415 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623523284736, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:48:330.826 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623493760768, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:48:775.739 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623531681536, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:48:775.974 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:48:776.041 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:48:776.058 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-policy:attr(default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-policy-allow-all-28987689,default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:48:776.099 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981 - virtual-network-network-policy:attr(default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-policy-allow-all-28987689,default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:48:776.135 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623489562368, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-policy:attr(default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-policy-allow-all-28987689,default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981) - network-policy:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-policy-allow-all-28987689 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-20 Mon 02:19:48:845.888 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623535879936, Pid 106128]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-20 Mon 02:19:48:861.235 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-20 Mon 02:19:48:861.280 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981:ctest-vn-61278981 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-20 Mon 02:19:48:861.306 UTC cn-jenkins-deploy-platform-ansible-os-2650-3 [Thread 139623519086336, Pid 106128]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981:ctest-vn-61278981 - virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-00453742:ctest-vn-61278981 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574