2025-01-16 00:51:17,097 [myid:] - INFO [main:QuorumPeerConfig@174] - Reading configuration from: /conf/zoo.cfg 2025-01-16 00:51:17,105 [myid:] - INFO [main:QuorumPeerConfig@441] - clientPortAddress is 10.0.0.23:2181 2025-01-16 00:51:17,106 [myid:] - INFO [main:QuorumPeerConfig@448] - secureClientPort is not set 2025-01-16 00:51:17,106 [myid:] - INFO [main:QuorumPeerConfig@464] - observerMasterPort is not set 2025-01-16 00:51:17,106 [myid:] - INFO [main:QuorumPeerConfig@481] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider 2025-01-16 00:51:17,117 [myid:3] - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3 2025-01-16 00:51:17,118 [myid:3] - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0 2025-01-16 00:51:17,118 [myid:3] - INFO [main:DatadirCleanupManager@101] - Purge task is not scheduled. 2025-01-16 00:51:17,119 [myid:3] - INFO [main:ManagedUtil@46] - Log4j 1.2 jmx support not found; jmx disabled. 2025-01-16 00:51:17,119 [myid:3] - INFO [main:QuorumPeerMain@152] - Starting quorum peer, myid=3 2025-01-16 00:51:17,135 [myid:3] - INFO [main:ServerMetrics@62] - ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@6bdf28bb 2025-01-16 00:51:17,138 [myid:3] - INFO [main:DigestAuthenticationProvider@47] - ACL digest algorithm is: SHA1 2025-01-16 00:51:17,139 [myid:3] - INFO [main:DigestAuthenticationProvider@61] - zookeeper.DigestAuthenticationProvider.enabled = true 2025-01-16 00:51:17,146 [myid:3] - INFO [main:ServerCnxnFactory@169] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory 2025-01-16 00:51:17,147 [myid:3] - WARN [main:ServerCnxnFactory@309] - maxCnxns is not configured, using default value 0. 2025-01-16 00:51:17,149 [myid:3] - INFO [main:NIOServerCnxnFactory@652] - Configuring NIO connection handler with 10s sessionless connection timeout, 1 selector thread(s), 8 worker threads, and 64 kB direct buffers. 2025-01-16 00:51:17,155 [myid:3] - INFO [main:NIOServerCnxnFactory@660] - binding to port /10.0.0.23:2181 2025-01-16 00:51:17,165 [myid:3] - INFO [main:QuorumPeer@797] - zookeeper.quorumCnxnTimeoutMs=-1 2025-01-16 00:51:17,173 [myid:3] - INFO [main:X509Util@77] - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 2025-01-16 00:51:17,179 [myid:3] - INFO [main:FileTxnSnapLog@124] - zookeeper.snapshot.trust.empty : true 2025-01-16 00:51:17,184 [myid:3] - INFO [main:QuorumPeer@1747] - Local sessions disabled 2025-01-16 00:51:17,185 [myid:3] - INFO [main:QuorumPeer@1758] - Local session upgrading disabled 2025-01-16 00:51:17,185 [myid:3] - INFO [main:QuorumPeer@1725] - tickTime set to 2000 2025-01-16 00:51:17,185 [myid:3] - INFO [main:QuorumPeer@1769] - minSessionTimeout set to 4000 2025-01-16 00:51:17,185 [myid:3] - INFO [main:QuorumPeer@1780] - maxSessionTimeout set to 40000 2025-01-16 00:51:17,185 [myid:3] - INFO [main:QuorumPeer@1805] - initLimit set to 5 2025-01-16 00:51:17,186 [myid:3] - INFO [main:QuorumPeer@1992] - syncLimit set to 2 2025-01-16 00:51:17,186 [myid:3] - INFO [main:QuorumPeer@2007] - connectToLearnerMasterLimit set to 0 2025-01-16 00:51:17,219 [myid:3] - INFO [main:ZookeeperBanner@42] - 2025-01-16 00:51:17,220 [myid:3] - INFO [main:ZookeeperBanner@42] - ______ _ 2025-01-16 00:51:17,220 [myid:3] - INFO [main:ZookeeperBanner@42] - |___ / | | 2025-01-16 00:51:17,220 [myid:3] - INFO [main:ZookeeperBanner@42] - / / ___ ___ | | __ ___ ___ _ __ ___ _ __ 2025-01-16 00:51:17,220 [myid:3] - INFO [main:ZookeeperBanner@42] - / / / _ \ / _ \ | |/ / / _ \ / _ \ | '_ \ / _ \ | '__| 2025-01-16 00:51:17,221 [myid:3] - INFO [main:ZookeeperBanner@42] - / /__ | (_) | | (_) | | < | __/ | __/ | |_) | | __/ | | 2025-01-16 00:51:17,221 [myid:3] - INFO [main:ZookeeperBanner@42] - /_____| \___/ \___/ |_|\_\ \___| \___| | .__/ \___| |_| 2025-01-16 00:51:17,221 [myid:3] - INFO [main:ZookeeperBanner@42] - | | 2025-01-16 00:51:17,221 [myid:3] - INFO [main:ZookeeperBanner@42] - |_| 2025-01-16 00:51:17,221 [myid:3] - INFO [main:ZookeeperBanner@42] - 2025-01-16 00:51:17,223 [myid:3] - INFO [main:Environment@98] - Server environment:zookeeper.version=3.7.1-a2fb57c55f8e59cdd76c34b357ad5181df1258d5, built on 2022-05-07 06:45 UTC 2025-01-16 00:51:17,224 [myid:3] - INFO [main:Environment@98] - Server environment:host.name=cn-jenkins-deploy-platform-ansible-os-2646-3. 2025-01-16 00:51:17,224 [myid:3] - INFO [main:Environment@98] - Server environment:java.version=1.8.0_402 2025-01-16 00:51:17,224 [myid:3] - INFO [main:Environment@98] - Server environment:java.vendor=Red Hat, Inc. 2025-01-16 00:51:17,225 [myid:3] - INFO [main:Environment@98] - Server environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.402.b06-1.el7_9.x86_64/jre 2025-01-16 00:51:17,225 [myid:3] - INFO [main:Environment@98] - Server environment:java.class.path=/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/target/classes:/apache-zookeeper-3.7.1-bin/bin/../build/classes:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/target/lib/*.jar:/apache-zookeeper-3.7.1-bin/bin/../build/lib/*.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-prometheus-metrics-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-jute-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/zookeeper-3.7.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/snappy-java-1.1.7.7.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/slf4j-reload4j-1.7.35.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/slf4j-api-1.7.35.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient_common-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/simpleclient-0.9.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/reload4j-1.2.19.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-native-unix-common-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-native-epoll-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-classes-epoll-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-transport-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-resolver-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-handler-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-common-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-codec-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/netty-buffer-4.1.76.Final.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/metrics-core-4.1.12.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jline-2.14.6.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-util-ajax-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-util-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-servlet-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-server-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-security-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-io-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jetty-http-9.4.43.v20210629.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-databind-2.13.2.1.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-core-2.13.2.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/jackson-annotations-2.13.2.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/commons-cli-1.4.jar:/apache-zookeeper-3.7.1-bin/bin/../lib/audience-annotations-0.12.0.jar:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-*.jar:/apache-zookeeper-3.7.1-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/conf: 2025-01-16 00:51:17,228 [myid:3] - INFO [main:Environment@98] - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2025-01-16 00:51:17,228 [myid:3] - INFO [main:Environment@98] - Server environment:java.io.tmpdir=/tmp 2025-01-16 00:51:17,228 [myid:3] - INFO [main:Environment@98] - Server environment:java.compiler= 2025-01-16 00:51:17,228 [myid:3] - INFO [main:Environment@98] - Server environment:os.name=Linux 2025-01-16 00:51:17,229 [myid:3] - INFO [main:Environment@98] - Server environment:os.arch=amd64 2025-01-16 00:51:17,229 [myid:3] - INFO [main:Environment@98] - Server environment:os.version=5.15.0-100-generic 2025-01-16 00:51:17,230 [myid:3] - INFO [main:Environment@98] - Server environment:user.name=zookeeper 2025-01-16 00:51:17,230 [myid:3] - INFO [main:Environment@98] - Server environment:user.home=/home/zookeeper 2025-01-16 00:51:17,230 [myid:3] - INFO [main:Environment@98] - Server environment:user.dir=/apache-zookeeper-3.7.1-bin 2025-01-16 00:51:17,230 [myid:3] - INFO [main:Environment@98] - Server environment:os.memory.free=222MB 2025-01-16 00:51:17,230 [myid:3] - INFO [main:Environment@98] - Server environment:os.memory.max=889MB 2025-01-16 00:51:17,230 [myid:3] - INFO [main:Environment@98] - Server environment:os.memory.total=238MB 2025-01-16 00:51:17,230 [myid:3] - INFO [main:ZooKeeperServer@138] - zookeeper.enableEagerACLCheck = false 2025-01-16 00:51:17,231 [myid:3] - INFO [main:ZooKeeperServer@151] - zookeeper.digest.enabled = true 2025-01-16 00:51:17,231 [myid:3] - INFO [main:ZooKeeperServer@155] - zookeeper.closeSessionTxn.enabled = true 2025-01-16 00:51:17,231 [myid:3] - INFO [main:ZooKeeperServer@1505] - zookeeper.flushDelay=0 2025-01-16 00:51:17,232 [myid:3] - INFO [main:ZooKeeperServer@1514] - zookeeper.maxWriteQueuePollTime=0 2025-01-16 00:51:17,232 [myid:3] - INFO [main:ZooKeeperServer@1523] - zookeeper.maxBatchSize=1000 2025-01-16 00:51:17,232 [myid:3] - INFO [main:ZooKeeperServer@260] - zookeeper.intBufferStartingSizeBytes = 1024 2025-01-16 00:51:17,238 [myid:3] - INFO [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager 2025-01-16 00:51:17,238 [myid:3] - INFO [main:WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager 2025-01-16 00:51:17,239 [myid:3] - INFO [main:ZKDatabase@133] - zookeeper.snapshotSizeFactor = 0.33 2025-01-16 00:51:17,239 [myid:3] - INFO [main:ZKDatabase@153] - zookeeper.commitLogCount=500 2025-01-16 00:51:17,267 [myid:3] - INFO [main:QuorumPeer@2071] - Using insecure (non-TLS) quorum communication 2025-01-16 00:51:17,268 [myid:3] - INFO [main:QuorumPeer@2077] - Port unification disabled 2025-01-16 00:51:17,268 [myid:3] - INFO [main:QuorumPeer@180] - multiAddress.enabled set to false 2025-01-16 00:51:17,268 [myid:3] - INFO [main:QuorumPeer@205] - multiAddress.reachabilityCheckEnabled set to true 2025-01-16 00:51:17,268 [myid:3] - INFO [main:QuorumPeer@192] - multiAddress.reachabilityCheckTimeoutMs set to 1000 2025-01-16 00:51:17,268 [myid:3] - INFO [main:QuorumPeer@2532] - QuorumPeer communication is not secured! (SASL auth disabled) 2025-01-16 00:51:17,268 [myid:3] - INFO [main:QuorumPeer@2557] - quorum.cnxn.threads.size set to 20 2025-01-16 00:51:17,277 [myid:3] - INFO [main:SnapStream@61] - zookeeper.snapshot.compression.method = CHECKED 2025-01-16 00:51:17,278 [myid:3] - INFO [main:FileTxnSnapLog@479] - Snapshotting: 0x0 to /data/version-2/snapshot.0 2025-01-16 00:51:17,281 [myid:3] - INFO [main:ZKDatabase@290] - Snapshot loaded in 12 ms, highest zxid is 0x0, digest is 1371985504 2025-01-16 00:51:17,281 [myid:3] - INFO [main:QuorumPeer@1157] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation 2025-01-16 00:51:17,290 [myid:3] - INFO [main:QuorumPeer@1185] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation 2025-01-16 00:51:17,297 [myid:3] - INFO [main:QuorumPeer@2574] - Using 4000ms as the quorum cnxn socket timeout 2025-01-16 00:51:17,302 [myid:3] - INFO [main:QuorumCnxManager$Listener@924] - Election port bind maximum retries is 3 2025-01-16 00:51:17,308 [myid:3] - INFO [main:FastLeaderElection@89] - zookeeper.fastleader.minNotificationInterval=200 2025-01-16 00:51:17,308 [myid:3] - INFO [main:FastLeaderElection@91] - zookeeper.fastleader.maxNotificationInterval=60000 2025-01-16 00:51:17,323 [myid:3] - INFO [main:ZKAuditProvider@42] - ZooKeeper audit is disabled. 2025-01-16 00:51:17,332 [myid:3] - INFO [ListenerHandler-/10.0.0.23:3888:QuorumCnxManager$Listener$ListenerHandler@1071] - 3 is accepting connections now, my election bind port: /10.0.0.23:3888 2025-01-16 00:51:17,336 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):QuorumPeer@1438] - LOOKING 2025-01-16 00:51:17,337 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):FastLeaderElection@945] - New election. My id = 3, proposed zxid=0x0 2025-01-16 00:51:17,350 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:3, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-01-16 00:51:17,352 [myid:3] - WARN [QuorumConnectionThread-[myid=3]-1:QuorumCnxManager@401] - Cannot open channel to 1 at election address /10.0.0.43:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-01-16 00:51:17,366 [myid:3] - WARN [QuorumConnectionThread-[myid=3]-2:QuorumCnxManager@401] - Cannot open channel to 2 at election address /10.0.0.29:3888 java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:384) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:458) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-01-16 00:51:17,476 [myid:3] - INFO [ListenerHandler-/10.0.0.23:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.29:60062 2025-01-16 00:51:17,508 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:2, n.state:LOOKING, n.leader:2, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-01-16 00:51:17,519 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LOOKING; n.sid:2, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-01-16 00:51:17,719 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):QuorumPeer@902] - Peer state changed: leading 2025-01-16 00:51:17,720 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):QuorumPeer@1532] - LEADING 2025-01-16 00:51:17,723 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):LearnerMaster@47] - zookeeper.leader.maxConcurrentSnapSyncs = 10 2025-01-16 00:51:17,723 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):LearnerMaster@50] - zookeeper.leader.maxConcurrentDiffSyncs = 100 2025-01-16 00:51:17,726 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):Leader@87] - TCP NoDelay set to: true 2025-01-16 00:51:17,726 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):Leader@108] - zookeeper.leader.ackLoggingFrequency = 1000 2025-01-16 00:51:17,726 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):Leader@1345] - zookeeper.leader.maxTimeToWaitForEpoch = -1ms 2025-01-16 00:51:17,729 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):BlueThrottle@141] - Weighed connection throttling is disabled 2025-01-16 00:51:17,730 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):ZooKeeperServer@1306] - minSessionTimeout set to 4000 2025-01-16 00:51:17,730 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):ZooKeeperServer@1315] - maxSessionTimeout set to 40000 2025-01-16 00:51:17,731 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):ResponseCache@45] - getData response cache size is initialized with value 400. 2025-01-16 00:51:17,731 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):ResponseCache@45] - getChildren response cache size is initialized with value 400. 2025-01-16 00:51:17,732 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):RequestPathMetricsCollector@109] - zookeeper.pathStats.slotCapacity = 60 2025-01-16 00:51:17,733 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):RequestPathMetricsCollector@110] - zookeeper.pathStats.slotDuration = 15 2025-01-16 00:51:17,733 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):RequestPathMetricsCollector@111] - zookeeper.pathStats.maxDepth = 6 2025-01-16 00:51:17,734 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):RequestPathMetricsCollector@112] - zookeeper.pathStats.initialDelay = 5 2025-01-16 00:51:17,734 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):RequestPathMetricsCollector@113] - zookeeper.pathStats.delay = 5 2025-01-16 00:51:17,734 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):RequestPathMetricsCollector@114] - zookeeper.pathStats.enabled = false 2025-01-16 00:51:17,738 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):ZooKeeperServer@1542] - The max bytes for all large requests are set to 104857600 2025-01-16 00:51:17,739 [myid:3] - INFO [ListenerHandler-/10.0.0.23:3888:QuorumCnxManager$Listener$ListenerHandler@1076] - Received connection request from /10.0.0.43:50804 2025-01-16 00:51:17,740 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):ZooKeeperServer@1556] - The large request threshold is set to -1 2025-01-16 00:51:17,741 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):AuthenticationHelper@66] - zookeeper.enforce.auth.enabled = false 2025-01-16 00:51:17,742 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):AuthenticationHelper@67] - zookeeper.enforce.auth.schemes = [] 2025-01-16 00:51:17,742 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):ZooKeeperServer@361] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 clientPortListenBacklog -1 datadir /data/version-2 snapdir /data/version-2 2025-01-16 00:51:17,746 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):Leader@584] - LEADING - LEADER ELECTION TOOK - 409 MS 2025-01-16 00:51:17,752 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: leading - discovery 2025-01-16 00:51:17,762 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LEADING; n.sid:1, n.state:LOOKING, n.leader:1, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-01-16 00:51:17,769 [myid:3] - INFO [WorkerReceiver[myid=3]:FastLeaderElection$Messenger$WorkerReceiver@390] - Notification: my state:LEADING; n.sid:1, n.state:LOOKING, n.leader:3, n.round:0x1, n.peerEpoch:0x0, n.zxid:0x0, message format version:0x2, n.config version:0x0 2025-01-16 00:51:17,776 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):FileTxnSnapLog@479] - Snapshotting: 0x0 to /data/version-2/snapshot.0 2025-01-16 00:51:17,779 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):ZooKeeperServer@543] - Snapshot taken in 3 ms 2025-01-16 00:51:17,787 [myid:3] - INFO [LearnerCnxAcceptorHandler-/10.0.0.23:2888:LearnerHandler@75] - zookeeper.leader.closeSocketAsync = false 2025-01-16 00:51:17,795 [myid:3] - INFO [LearnerHandler-/10.0.0.29:48436:LearnerHandler@509] - Follower sid: 2 : info : 10.0.0.29:2888:3888:participant 2025-01-16 00:51:17,816 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):QuorumPeer@1875] - Dynamic reconfig is disabled, we don't store the last seen config. 2025-01-16 00:51:17,826 [myid:3] - INFO [LearnerHandler-/10.0.0.29:48436:ZKDatabase@346] - On disk txn sync enabled with snapshotSizeFactor 0.33 2025-01-16 00:51:17,826 [myid:3] - INFO [LearnerHandler-/10.0.0.29:48436:LearnerHandler@804] - Synchronizing with Learner sid: 2 maxCommittedLog=0x0 minCommittedLog=0x0 lastProcessedZxid=0x0 peerLastZxid=0x0 2025-01-16 00:51:17,826 [myid:3] - INFO [LearnerHandler-/10.0.0.29:48436:LearnerHandler@849] - Sending DIFF zxid=0x0 for peer sid: 2 2025-01-16 00:51:17,838 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: leading - synchronization 2025-01-16 00:51:17,902 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):Leader@1495] - Have quorum of supporters, sids: [[2, 3]]; starting up and setting last processed zxid: 0x100000000 2025-01-16 00:51:17,902 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):Leader@1517] - Dynamic reconfig feature is disabled, skip designatedLeader calculation and reconfig processing. 2025-01-16 00:51:17,911 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):CommitProcessor@491] - Configuring CommitProcessor with readBatchSize -1 commitBatchSize 1 2025-01-16 00:51:17,911 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):CommitProcessor@452] - Configuring CommitProcessor with 4 worker threads. 2025-01-16 00:51:17,919 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):ProposalRequestProcessor@57] - zookeeper.forward_learner_requests_to_commit_processor_disabled = false 2025-01-16 00:51:17,948 [myid:3] - INFO [ProcessThread(sid:3 cport:-1)::PrepRequestProcessor@137] - PrepRequestProcessor (sid:3) started, reconfigEnabled=false 2025-01-16 00:51:17,948 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):ContainerManager@84] - Using checkIntervalMs=60000 maxPerMinute=10000 maxNeverUsedIntervalMs=0 2025-01-16 00:51:17,949 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):RequestThrottler@75] - zookeeper.request_throttler.shutdownTimeout = 10000 2025-01-16 00:51:17,974 [myid:3] - INFO [QuorumPeer[myid=3](plain=10.0.0.23:2181)(secure=disabled):QuorumPeer@916] - Peer state changed: leading - broadcast 2025-01-16 00:51:18,048 [myid:3] - INFO [LearnerHandler-/10.0.0.43:40876:LearnerHandler@509] - Follower sid: 1 : info : 10.0.0.43:2888:3888:participant 2025-01-16 00:51:18,072 [myid:3] - INFO [LearnerHandler-/10.0.0.43:40876:ZKDatabase@346] - On disk txn sync enabled with snapshotSizeFactor 0.33 2025-01-16 00:51:18,072 [myid:3] - INFO [LearnerHandler-/10.0.0.43:40876:LearnerHandler@804] - Synchronizing with Learner sid: 1 maxCommittedLog=0x0 minCommittedLog=0x0 lastProcessedZxid=0x100000000 peerLastZxid=0x0 2025-01-16 00:51:18,074 [myid:3] - INFO [LearnerHandler-/10.0.0.43:40876:LearnerHandler@571] - Sending snapshot last zxid of peer is 0x0, zxid of leader is 0x100000000, send zxid of db as 0x100000000, 1 concurrent snapshot sync, snapshot sync was exempt from throttle 2025-01-16 00:52:57,171 [myid:3] - INFO [SyncThread:3:FileTxnLog@284] - Creating new log file: log.100000001 2025-01-16 00:52:57,188 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0000 2025-01-16 00:52:57,308 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0001 2025-01-16 00:52:57,476 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0002 2025-01-16 00:52:57,517 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0000 2025-01-16 00:52:57,639 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0003 2025-01-16 00:52:57,762 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d0000 2025-01-16 00:52:57,799 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0004 2025-01-16 00:52:57,966 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d0001 2025-01-16 00:52:58,030 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0001 2025-01-16 00:52:58,050 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0002 2025-01-16 00:52:58,381 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0005 2025-01-16 00:52:58,509 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0006 2025-01-16 00:52:58,618 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0003 2025-01-16 00:52:58,870 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d0002 2025-01-16 00:52:59,094 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0007 2025-01-16 00:53:12,816 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0008 2025-01-16 00:53:15,679 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0009 2025-01-16 00:53:15,939 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0004 2025-01-16 00:53:16,470 [myid:3] - WARN [NIOWorkerThread-4:NIOServerCnxn@371] - Unexpected exception EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /10.0.0.29:58538, session = 0x300001f544a0003 at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:170) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:333) at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:508) at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-01-16 00:53:18,663 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e000a 2025-01-16 00:53:25,238 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e000b 2025-01-16 00:53:25,349 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d0003 2025-01-16 00:53:27,483 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0005 2025-01-16 00:53:27,636 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0006 2025-01-16 00:53:56,711 [myid:3] - INFO [SessionTracker:ZooKeeperServer@628] - Expiring session 0x1000020da1e0009, timeout of 40000ms exceeded 2025-01-16 00:53:56,712 [myid:3] - INFO [SessionTracker:ZooKeeperServer@628] - Expiring session 0x300001f544a0003, timeout of 40000ms exceeded 2025-01-16 00:53:56,712 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x1000020da1e0009 2025-01-16 00:53:56,712 [myid:3] - INFO [SessionTracker:ZooKeeperServer@628] - Expiring session 0x1000020da1e0006, timeout of 40000ms exceeded 2025-01-16 00:53:56,712 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x300001f544a0003 2025-01-16 00:53:56,712 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x1000020da1e0006 2025-01-16 00:53:58,710 [myid:3] - INFO [SessionTracker:ZooKeeperServer@628] - Expiring session 0x1000020da1e0005, timeout of 40000ms exceeded 2025-01-16 00:53:58,710 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x1000020da1e0005 2025-01-16 00:54:09,895 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0007 2025-01-16 00:57:15,046 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0008 2025-01-16 00:57:15,133 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d0004 2025-01-16 00:57:15,352 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0009 2025-01-16 00:57:16,056 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a000a 2025-01-16 00:57:16,159 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e000c 2025-01-16 00:57:16,365 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a000b 2025-01-16 00:57:21,116 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d0005 2025-01-16 00:57:21,460 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d0006 2025-01-16 00:57:21,654 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a000c 2025-01-16 00:57:28,151 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x300001f544a000a 2025-01-16 00:57:29,567 [myid:3] - INFO [RequestThrottler:QuorumZooKeeperServer@163] - Submitting global closeSession request for session 0x300001f544a000b 2025-01-16 00:57:39,836 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a000d 2025-01-16 00:57:40,549 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a000e 2025-01-16 00:57:40,718 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e000d 2025-01-16 00:57:44,026 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e000e 2025-01-16 00:57:44,246 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d0007 2025-01-16 00:57:44,263 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d0008 2025-01-16 00:57:44,429 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e000f 2025-01-16 00:57:44,531 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0010 2025-01-16 00:57:44,640 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a000f 2025-01-16 00:57:58,397 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0010 2025-01-16 00:57:58,630 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0011 2025-01-16 00:57:58,655 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0012 2025-01-16 00:57:58,720 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d0009 2025-01-16 00:57:58,839 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x2000020236d000a 2025-01-16 00:57:58,857 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0011 2025-01-16 00:57:58,947 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0013 2025-01-16 00:57:58,967 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0012 2025-01-16 00:57:59,015 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0013 2025-01-16 00:57:59,140 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0014 2025-01-16 00:57:59,324 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x300001f544a0014 2025-01-16 00:57:59,489 [myid:3] - INFO [CommitProcessor:3:LeaderSessionTracker@104] - Committing global session 0x1000020da1e0015 2025-01-16 01:02:22,001 [myid:3] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x10000cb6b to /data/version-2/snapshot.10000cb6b 2025-01-16 01:02:22,002 [myid:3] - INFO [SyncThread:3:FileTxnLog@284] - Creating new log file: log.10000cb6c 2025-01-16 01:02:22,023 [myid:3] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 22 ms 2025-01-16 01:08:56,651 [myid:3] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x10001f20d to /data/version-2/snapshot.10001f20d 2025-01-16 01:08:56,652 [myid:3] - INFO [SyncThread:3:FileTxnLog@284] - Creating new log file: log.10001f210 2025-01-16 01:08:56,661 [myid:3] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 10 ms 2025-01-16 01:14:42,071 [myid:3] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x10002faa1 to /data/version-2/snapshot.10002faa1 2025-01-16 01:14:42,077 [myid:3] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 6 ms 2025-01-16 01:14:42,086 [myid:3] - INFO [SyncThread:3:FileTxnLog@284] - Creating new log file: log.10002faa5 2025-01-16 01:20:06,773 [myid:3] - INFO [Snapshot Thread:FileTxnSnapLog@479] - Snapshotting: 0x10003f37a to /data/version-2/snapshot.10003f37a 2025-01-16 01:20:06,780 [myid:3] - INFO [Snapshot Thread:ZooKeeperServer@543] - Snapshot taken in 7 ms 2025-01-16 01:20:06,783 [myid:3] - INFO [SyncThread:3:FileTxnLog@284] - Creating new log file: log.10003f37c