05/26/2025 00:47:00.033 7ff9513ed898 [contrail-topology] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 05/26/2025 00:47:00.033 7ff9513ed898 [contrail-topology] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 05/26/2025 00:47:00.033 7ff9513ed898 [contrail-topology] [INFO]: SANDESH: Flow Logging: [None] -> [False] 05/26/2025 00:47:00.033 7ff9513ed898 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 05/26/2025 00:47:00.033 7ff9513ed898 [contrail-topology] [INFO]: Consistent scheduler zk start 05/26/2025 00:47:00.034 7ff94b11bd48 [contrail-topology] [ERROR]: Cannot write http_port 5921 to /tmp/contrail-topology.0.http_port 05/26/2025 00:47:00.034 7ff94b11bd48 [contrail-topology] [ERROR]: Starting Introspect on HTTP Port 5921 05/26/2025 00:47:00.034 7ff948687848 [contrail-topology] [INFO]: Processing event[EvStart] in state[none] 05/26/2025 00:47:00.036 7ff948687848 [contrail-topology] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/26/2025 00:47:00.036 7ff948687848 [contrail-topology] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 05/26/2025 00:47:00.036 7ff948687848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.036 7ff948687848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized] connection down >>, ] >> 05/26/2025 00:47:00.036 7ff948687848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.036 7ff948687848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.036 7ff948687848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/26/2025 00:47:00.036 7ff948687848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.037 7ff948687848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.037 7ff948687848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3.:AnalyticsSNMP:contrail-topology:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 5921 start_time = 1748220420035985 collector_name = collector_ip = collector_list = [ 10.0.0.61:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 05/26/2025 00:47:00.037 7ff948687848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.045 7ff9485bc848 [contrail-topology] [INFO]: Consistent scheduler listen CONNECTED 05/26/2025 00:47:00.047 7ff948687848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.048 7ff948687848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/26/2025 00:47:00.048 7ff948687848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.114 7ff9485bcb48 [contrail-topology] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.19:5673//', 'pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.61:5673//'] 05/26/2025 00:47:00.119 7ff9485bcb48 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 05/26/2025 00:47:00.120 7ff9485bce48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.120 7ff9485bce48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 05/26/2025 00:47:00.120 7ff9485bce48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.120 7ff9485bce48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.120 7ff9485bce48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 05/26/2025 00:47:00.120 7ff9485bce48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.172 7ff9485bcb48 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 05/26/2025 00:47:00.172 7ff9485bce48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.172 7ff9485bce48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/26/2025 00:47:00.173 7ff9485bce48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.224 7ff9485bcb48 [contrail-topology] [WARNING]: RabbitMQ publish connection down 05/26/2025 00:47:00.224 7ff9485bce48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.225 7ff9485bce48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 05/26/2025 00:47:00.225 7ff9485bce48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.230 7ff9485bcb48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 05/26/2025 00:47:00.230 7ff9485bce48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.230 7ff9485bce48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/26/2025 00:47:00.230 7ff9485bce48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.233 7ff9485bcb48 [contrail-topology] [WARNING]: VNCCassandra started with driver cql 05/26/2025 00:47:00.233 7ff9485bcb48 [contrail-topology] [WARNING]: initializing cassandra cluster 05/26/2025 00:47:00.234 7ff9485bcb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster before create 05/26/2025 00:47:00.234 7ff9485bce48 [contrail-topology] [WARNING]: RabbitMQ publish connection down 05/26/2025 00:47:00.235 7ff947642b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.235 7ff947642b48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 05/26/2025 00:47:00.235 7ff947642b48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.235 7ff947642b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.235 7ff947642b48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[], Database:Cassandra[] connection down >>, ] >> 05/26/2025 00:47:00.235 7ff947642b48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.236 7ff9485bcb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster created 05/26/2025 00:47:00.267 7ff9485bca48 [contrail-topology] [DEBUG]: Waiting for allocation... 05/26/2025 00:47:00.281 7ff9485bce48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 05/26/2025 00:47:00.281 7ff946a00048 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.281 7ff946a00048 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 05/26/2025 00:47:00.288 7ff946a00048 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.350 7ff9485bcb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 05/26/2025 00:47:00.356 7ff946a02b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.358 7ff946a02b48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 05/26/2025 00:47:00.358 7ff946a02b48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.390 7ff9485bcb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 05/26/2025 00:47:00.390 7ff946a02848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.392 7ff946a02848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 05/26/2025 00:47:00.393 7ff946a02848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.416 7ff9485bcb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 05/26/2025 00:47:00.454 7ff9485bcb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 05/26/2025 00:47:00.455 7ff94695e748 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:00.455 7ff94695e748 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 05/26/2025 00:47:00.455 7ff94695e748 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 05/26/2025 00:47:04.036 7ff94695e948 [contrail-topology] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 05/26/2025 00:47:04.038 7ff94695e948 [contrail-topology] [INFO]: Session Event: TCP Connected 05/26/2025 00:47:04.038 7ff94695e948 [contrail-topology] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 05/26/2025 00:47:04.038 7ff94695e948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 05/26/2025 00:47:04.038 7ff94695e948 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3335-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.19:2181, 10.0.0.41:2181, 10.0.0.61:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.61:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.19:5673, 10.0.0.41:5673, 10.0.0.61:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.19:9041, 10.0.0.41:9041, 10.0.0.61:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 05/26/2025 00:47:04.038 7ff94695e948 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 05/26/2025 00:47:04.038 7ff94695e948 [contrail-topology] [INFO]: Processing event[EvTcpConnected] in state[Connect] 05/26/2025 00:47:04.038 7ff94695e948 [contrail-topology] [DEBUG]: Send sandesh control message. uve type count # 5 05/26/2025 00:47:04.039 7ff94695e948 [contrail-topology] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 05/26/2025 00:47:04.039 7ff94695e948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/26/2025 00:47:04.039 7ff94695e948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 05/26/2025 00:47:04.039 7ff94695eb48 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/26/2025 00:47:04.040 7ff94695eb48 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/26/2025 00:47:04.047 7ff94695ea48 [contrail-topology] [DEBUG]: Extracted sandesh length: 0000001017 05/26/2025 00:47:04.048 7ff94695ea48 [contrail-topology] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 05/26/2025 00:47:04.048 7ff94695eb48 [contrail-topology] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 05/26/2025 00:47:04.048 7ff94695eb48 [contrail-topology] [DEBUG]: Number of uve types in sandesh control message is 0 05/26/2025 00:47:04.048 7ff94695eb48 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 05/26/2025 00:47:04.048 7ff94695eb48 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 05/26/2025 00:47:04.049 7ff94695eb48 [contrail-topology] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 05/26/2025 00:47:04.049 7ff9485bc948 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 05/26/2025 00:47:04.050 7ff9485bc948 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 05/26/2025 00:47:31.284 7ff9485bca48 [contrail-topology] [DEBUG]: Waiting for allocation... 05/26/2025 00:48:00.150 7ff948687848 [contrail-topology] [INFO]: members: ['cn-jenkins-deploy-platform-ansible-os-3335-3.-1', 'cn-jenkins-deploy-platform-ansible-os-3335-2.-1', 'cn-jenkins-deploy-platform-ansible-os-3335-1.-1'] 05/26/2025 00:48:00.151 7ff948687848 [contrail-topology] [INFO]: partitions: ['1', '2', '7', '8', '16', '23', '25', '28', '30', '31', '32', '33', '37', '39', '40', '41', '43', '46'] 05/26/2025 00:48:01.345 7ff9485bca48 [contrail-topology] [DEBUG]: got work: ['1', '2', '7', '8', '16', '23', '25', '28', '30', '31', '32', '33', '37', '39', '40', '41', '43', '46'] 05/26/2025 00:48:01.345 7ff9485bca48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 05/26/2025 00:48:01.345 7ff9485bca48 [contrail-topology] [DEBUG]: work items: [] from the list [] 05/26/2025 00:48:01.345 7ff9485bca48 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:TopologyUVE] map 05/26/2025 00:48:36.461 7ff947642a48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-4d1a0e1f-4c03-485f-b151-5af49dfe1674', 'type': 'global_system_config', 'uuid': 'be5ad7d3-1178-4abe-bce5-c6fed561d326'} 05/26/2025 00:48:36.496 7ff947642a48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-d1870c13-2211-4d39-9661-712cef5efc58', 'type': 'global_system_config', 'uuid': 'be5ad7d3-1178-4abe-bce5-c6fed561d326'} 05/26/2025 00:48:36.595 7ff947642a48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3335-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3335-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3335-1'], 'id_perms': {'created': '2025-05-26T00:48:36.586526', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-26T00:48:36.586526', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12774880448280109631, 'uuid_mslong': 5962796790867445186}}, 'parent_type': 'global-system-config', 'parent_uuid': 'be5ad7d3-1178-4abe-bce5-c6fed561d326', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '52c01c16-cb7e-45c2-b149-7e155fd1a23f', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-311f92bb-457e-4ba4-953c-0684a56b3434', 'type': 'virtual_router', 'uuid': '52c01c16-cb7e-45c2-b149-7e155fd1a23f'} 05/26/2025 00:48:36.662 7ff947642a48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3335-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3335-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3335-2'], 'id_perms': {'created': '2025-05-26T00:48:36.648095', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-26T00:48:36.648095', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12350364892800903156, 'uuid_mslong': 1020463542237219562}}, 'parent_type': 'global-system-config', 'parent_uuid': 'be5ad7d3-1178-4abe-bce5-c6fed561d326', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0e296a2f-5d49-4aea-ab65-4f6f59da67f4', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.129'}, 'oper': 'CREATE', 'request-id': 'req-b10b19c9-0a26-4d43-ab8c-b9ebdf55641c', 'type': 'virtual_router', 'uuid': '0e296a2f-5d49-4aea-ab65-4f6f59da67f4'} 05/26/2025 00:48:36.945 7ff947642a48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3335-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3335-1', 'vhost0'], 'id_perms': {'created': '2025-05-26T00:48:36.931363', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-26T00:48:36.931363', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10043135547604446531, 'uuid_mslong': 11264600474018859880}}, 'parent_type': 'virtual-router', 'parent_uuid': '52c01c16-cb7e-45c2-b149-7e155fd1a23f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9c53e672-de97-4b68-8b60-6291da0fad43', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:9c:53:e6:72:de']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '82708503-f566-4e0e-b4cb-ebbe20964732'}]}, 'oper': 'CREATE', 'request-id': 'req-aa6d91af-7ff1-40e9-9fcc-3261c606e896', 'type': 'virtual_machine_interface', 'uuid': '9c53e672-de97-4b68-8b60-6291da0fad43'} 05/26/2025 00:48:36.990 7ff947642a48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3335-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-aa6d91af-7ff1-40e9-9fcc-3261c606e896', 'type': 'virtual_machine_interface', 'uuid': '9c53e672-de97-4b68-8b60-6291da0fad43'} 05/26/2025 00:48:37.021 7ff947642a48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3335-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3335-2', 'vhost0'], 'id_perms': {'created': '2025-05-26T00:48:37.001883', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-05-26T00:48:37.001883', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11163773284619950605, 'uuid_mslong': 12968013669036409312}}, 'parent_type': 'virtual-router', 'parent_uuid': '0e296a2f-5d49-4aea-ab65-4f6f59da67f4', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b3f7a3b9-7953-41e0-9aed-b0a776c49a0d', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:b3:f7:a3:b9:79']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '82708503-f566-4e0e-b4cb-ebbe20964732'}]}, 'oper': 'CREATE', 'request-id': 'req-89e6a523-0aa4-494d-bed1-4f24bf019a36', 'type': 'virtual_machine_interface', 'uuid': 'b3f7a3b9-7953-41e0-9aed-b0a776c49a0d'} 05/26/2025 00:48:37.063 7ff947642a48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3335-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-89e6a523-0aa4-494d-bed1-4f24bf019a36', 'type': 'virtual_machine_interface', 'uuid': 'b3f7a3b9-7953-41e0-9aed-b0a776c49a0d'} 05/26/2025 00:48:37.486 7ff947642a48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-b6596350-7653-4b17-923a-60a6ad34b6cc', 'type': 'access_control_list', 'uuid': 'e5c80a49-54b2-432e-bbcc-f4e25e4e595d'} 05/26/2025 00:49:31.080 7ff948687848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 05/26/2025 00:49:41.903 7ff948687848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 05/26/2025 00:58:01.371 7ff9485bca48 [contrail-topology] [DEBUG]: got work: ['1', '2', '7', '8', '16', '23', '25', '28', '30', '31', '32', '33', '37', '39', '40', '41', '43', '46'] 05/26/2025 00:58:01.371 7ff9485bca48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 05/26/2025 00:58:01.371 7ff9485bca48 [contrail-topology] [DEBUG]: work items: [] from the list [] 05/26/2025 01:08:01.398 7ff9485bca48 [contrail-topology] [DEBUG]: got work: ['1', '2', '7', '8', '16', '23', '25', '28', '30', '31', '32', '33', '37', '39', '40', '41', '43', '46'] 05/26/2025 01:08:01.399 7ff9485bca48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 05/26/2025 01:08:01.399 7ff9485bca48 [contrail-topology] [DEBUG]: work items: [] from the list [] 05/26/2025 01:18:01.415 7ff9485bca48 [contrail-topology] [DEBUG]: got work: ['1', '2', '7', '8', '16', '23', '25', '28', '30', '31', '32', '33', '37', '39', '40', '41', '43', '46'] 05/26/2025 01:18:01.415 7ff9485bca48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 05/26/2025 01:18:01.416 7ff9485bca48 [contrail-topology] [DEBUG]: work items: [] from the list [] 05/26/2025 01:28:01.433 7ff9485bca48 [contrail-topology] [DEBUG]: got work: ['1', '2', '7', '8', '16', '23', '25', '28', '30', '31', '32', '33', '37', '39', '40', '41', '43', '46'] 05/26/2025 01:28:01.433 7ff9485bca48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 05/26/2025 01:28:01.433 7ff9485bca48 [contrail-topology] [DEBUG]: work items: [] from the list [] 05/26/2025 01:38:01.468 7ff9485bca48 [contrail-topology] [DEBUG]: got work: ['1', '2', '7', '8', '16', '23', '25', '28', '30', '31', '32', '33', '37', '39', '40', '41', '43', '46'] 05/26/2025 01:38:01.469 7ff9485bca48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 05/26/2025 01:38:01.469 7ff9485bca48 [contrail-topology] [DEBUG]: work items: [] from the list [] 05/26/2025 01:48:01.493 7ff9485bca48 [contrail-topology] [DEBUG]: got work: ['1', '2', '7', '8', '16', '23', '25', '28', '30', '31', '32', '33', '37', '39', '40', '41', '43', '46'] 05/26/2025 01:48:01.493 7ff9485bca48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 05/26/2025 01:48:01.493 7ff9485bca48 [contrail-topology] [DEBUG]: work items: [] from the list [] 05/26/2025 01:53:36.904 7ff948687848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map